Top
Best
New

Posted by sebjones 2 days ago

Transcribe.cpp(workshop.cjpais.com)
763 points | 164 commentspage 5
bazzingadev 2 days ago|
Hey, thanks for this.
ilaksh 2 days ago||
I don't suppose this works in the browser?
sipjca 2 days ago|
Out of the box no probably not, but if people are interested there’s probably ways forward
_medihack_ 2 days ago||
Absolutely interested
aghilmort 1 day ago||
wip <> WASM-tested baseline models yesterday / doing webgpu binds

required pinned ggml patch & OMP,SIMD,etc. tweaks to make all models efficient, this work meshes well with other builds been doing with all-way sherpa onnx etc.

kzyxx11 2 days ago||
Excellent work
JeremyHerrman 2 days ago||
Another happy user of Handy here!

After seeing so many *subscription based* transcription apps all wrapping *open source models*, finding Handy was a real delight and I'm happy to see the author keep on building!

shade 2 days ago||
Nice - I'm definitely going to take a look at this. I've built my own cross-platform (Mac/Win/Linux) live captioning app on top of Nemotron, and it works well but dealing with ONNX is kind of annoying. With this having Rust support (I built it on Rust/Tauri) it should be a pretty solid candidate; I'll have to see if I can find a Silero VAD implementation that doesn't depend on ONNX, or maybe I'll see if the clankers can migrate it for me.
nohup2 2 days ago|
Have you published your app? I would love to take a look and test it
shade 2 days ago||
I have not formally published it, but it's open source: https://github.com/edmistond/larmindon and https://github.com/edmistond/larmindon-core - you'll want to clone them into the same root directory.

Right now it only supports languages supported by parakeet-rs and Nemotron (so... English only as far as I'm aware) and you'll need the ONNX version of Nemotron: https://huggingface.co/altunenes/parakeet-rs/tree/main/nemot...

The first run experience isn't great, you'll need to download all the files from the model, start the app, and then go to settings and configure the model directory. It runs well on Mac and Windows; I haven't tested it on Linux in a couple of months since my Linux install is out of commission currently.

tlamponi 2 days ago||
Has anybody experience with using this with strong dialects, like e.g. bavarian-family (German) based ones? Or other languages one too, as I'd figure basic behavior and approaches to improve detection of such is often similar in principle for dialect style variants of a language.

I mean, I naturally should try myself, and plan to do so, but slightly lower on my free time priority list and I figured someone else might have explored this already.

zuzululu 2 days ago||
would love to see a demo handy is fantastic although its still behind the frontier models
therealpygon 2 days ago|
Pretty sure I saw Handy using it; if you have the latest version, you’re probably already demoing it.
sipjca 2 days ago|||
Yep the latest version has support! Virtually all of the SOTA open models are supported by Handy including the streaming ones like

Nemotron Streaming

Parakeet Unified

Voxtral Mini Realtime

If something you want is not supported, open an issue on transcribe.cpp!

loufe 2 days ago||||
author of the blogpost is the maintainer of Handy, so almost guaranteed!
zuzululu 2 days ago|||
I installed it but I don't think I see the streaming transcriptions. I do think the transcription is a bit faster. I am using the latest version.
qntmfred 2 days ago||
You have to change the model to one that supports streaming. The latest parakeet does. I've been using it the last week or so. It's good stuff :)
therealpygon 3 hours ago||
I tried nemotron but the zero punctuation was a no go. I also used unified but didn’t see streaming. That said, I had to disable direct input because my shortcut for handy includes a ctrl-, so direct causes menu and shortcut activations at lightning speed, so I am only getting output when recording stops.

Still, you can pry Handy from my cold dead hands-y either way. So useful.

wolvoleo 2 days ago||
Looks interesting, I'll give it a try. Though I'm really happy with faster-whisper on a GPU.
ktosobcy 1 day ago||
Yet another happy user of Handy - one of the best applications out there, kudos! <3
primaprashant 2 days ago|
Handy is an amazing cross-platform app for dictation from the author. There are other awesome open-source dictation tools as well like native macOS ones. You do not need SaaS subscription in this day and age for transcription.

I maintain this list of all the best open-source ones in this awesome-style GitHub repo. People looking for open-source dictation tools, hope you find something that works for you here:

https://github.com/primaprashant/awesome-voice-typing

rubidium 2 days ago|
Any that also support translation? How much harder/ easier of a problem is local translation compared to transcription?
primaprashant 2 days ago||
If you're talking about translated text, then that should be super easy. Most of these dictation tool support post-processing with LLM to remove filler words, fix punctuation, etc. I'd imagine you can change the system prompt for the post-processing step to do the translation instead, and you'd get translated text.
rubidium 2 days ago||
Yea I’m looking local hosted transcription and translation with diarization of 2 (or more ) speakers. This is to speed up collaborative technical work between two teams who speak different languages where want all local processing (assume no cloud access).
More comments...