Top
Best
New

Posted by k9294 11 hours ago

Gemini-3.5-Transcribe(blog.google)
210 points | 59 comments
Lucasoato 7 hours ago|
I’ve tested at least 20 STT models in a benchmark I’ve set up with German, Italian and English voices from meetings in my company.

The voices contained very industry specific words, the languages changed from one sentence to another, sometimes words in a language were mentioned while a discussion was in another.

The only local model that satisfies me is Voxtral Mini 3b, the only paid API that is slightly better is eleven labs. Yes, Voxtral might not reach the best score in the benchmarks, but to me, it just solves a problem. It might not be the best in terms of speed... but that’s not a problem for me.

Happy to test this new model from Google but I’m not sure I’d go with that instead of something that can run so easily in my machine.

crossroadsguy 2 hours ago||
Do you use it on a desktop? Mac by any chance? What's your setup?

I've been looking to find a simple and fast dictation app for English but almost everything I've tried (from Handy to many apps, eg some with Whisper in their names, after the model I assume) just don't work well. Apple's offering is worse than those though. I even tried with local enhancement models.

pomtato 1 hour ago||
You should give VoiceInk[1] a go. It works great and has decent latency.

https://github.com/Beingpax/VoiceInk

hinnisdael 6 hours ago|||
Agree about Voxtral being the only model — local or cloud — that handles multilingual conversation really well. I‘m not sure what they do differently, but mixed-language sentences and industry terms don‘t seem to faze it where other model begin to struggle.
anton000 1 hour ago|||
have you tried groq whisper-turbo? works well for me for multiple different languages
kridsdale1 5 hours ago|||
I use Parakeet 3. How does that fare in your testing?
Lucasoato 5 hours ago||
I love it but it misses the business specific words when in different language. Sometimes it stretches them out to fit unrelated words in the language of the rest of the conversation. I miss its speed though.
wahnfrieden 5 hours ago|||
Try the recent MOSS one? It’s very good
cnxhk 6 hours ago||
Any possibility to share some of the eval audio?
Lucasoato 5 hours ago||
Of course not, but it’s easily replicable just by mixing different languages conversations together, adding a word here and there of some very specific German jargon.
lnalx 54 minutes ago||
I personally tested all the STT models for my real-time translator (https://fliptalk.ai). From language detection and accuracy in a noisy environment to the most important point: latency.

At the moment, Soniox STT v5 is definitely the best, and I'm impressed by its performance. It's good that Google released Gemini-3.5-Transcribe, and it beats every other model on accuracy, but it definitely needs a bit more work on latency, which is the most important factor for STT apps.

low_tech_punk 24 minutes ago||
Soniox website has a live comparison demo: https://soniox.com/compare-stt

For me, Gemini-3.5-Transcribe actually has slightly lower latency. Kudos to Soniox for both paying their competitor and letting them win. But yes, Soniox is much cheaper.

sgt 2 minutes ago||
Interesting, I uploaded a voice recording from a meeting I had recorded with a relatively cheap microphone.

Soniox came out really good. OpenAI started getting some things very wrong and even introduced some German. Google did okay but cut off the start by several seconds.

What's Soniox doing (left most) that's making it so good ? It was also the only one that could distinguish between the speakers.

decimalenough 32 minutes ago||
Depends on your use case. If you're transcribing meeting notes, latency is a non-issue.
ameliaquining 2 hours ago||
"Function calling: The model can delegate complex tasks (such as image generation and file analysis) to other Gemini models via function calls. Currently available in the Gemini macOS app."

This confused the heck out of me because it makes it sound like the STT model can make function calls in order to execute arbitrary tasks, which wouldn't make any sense. The developer docs (https://ai.google.dev/gemini-api/docs/models/gemini-3.5-tran...) confirm that the Gemini 3.5 Transcribe model cannot in fact make function calls. I guess the blog post is just using very confusing wording to describe how their consumer assistant/chatbot app can both take audio input via Gemini 3.5 Transcribe and then call other things as needed. Or maybe that bullet point was meant to be for a different model announcement and somebody made an editing error.

Nifty3929 46 minutes ago||
Remember that function calling doesn’t mean that the model is actually calling a function for you: what it does it interpret the intent, then return back to the application the function and arguments, then the application runs the function with those arguments.

Think voice control for your device. You speak, and it returns back instructions ( a function and arguments) for your device to be execute.

anukin 2 hours ago||
Probably written using Gemini which hallucinated.
ameliaquining 2 hours ago||
Pangram says human: https://www.pangram.com/history/a69f9b74-eb46-44b9-a087-7822...
huijzer 1 hour ago||
Maybe I missed something, but isn’t it impossible to detect whether something is written by AI or not? A human on a bad day can write like AI while an AI on a good day can write like a human.
mediaman 1 hour ago|||
No, that's not correct for any reasonable definition of "impossible." Look up pangram's accuracy ratings. It's not perfect, but it's pretty good. LLMs in fact leave very distinguishing traces of their logit distributions in the text they write. It's one of the reasons why it's so easy for humans to also smell them.

It is possible to trick pangram - they bias toward a low false positive and a higher false negative - but it is not true that it is essentially random.

ameliaquining 1 hour ago|||
https://bfi.uchicago.edu/wp-content/uploads/2025/09/BFI_WP_2...
Crystalin 7 hours ago||
I've been testing it on Pixel 11 Pro and I mostly dislike it. It is convenient when you have something long to say without thinking about it first. But the main issue is when you want to say something precise with specific wording it might "simplify" it and break the meaning.

Something like "I hesitated to check it, I should have verified" => "I should have verified" (The "I hesitated..." is removed but I said it because I wanted to let the person know that I thought about it earlier)

I tried the sentence few times and it always removed the first part.

sync 6 hours ago|
Are you in Smart or Verbatim mode?

https://ai.google.dev/gemini-api/docs/transcribe#transcripti...

skinfaxi 5 hours ago||
They mentioned the pixel phone so probably using https://blog.google/products-and-platforms/platforms/android...
zhivota 3 hours ago||
I'd certainly use Gemini API a lot more if I could figure out how to give them money and they give me tokens. The whole tier nonsense is just insane hoop jumping compared to their competition.
Frannky 55 minutes ago||
I don't really need this model, but I needed a fast my voice to command thing, and Gemini flash 2.5 was extremely effective(low latency, high speed).

No need to go from audio to text to reasoning, just from audio to output json for running a command via adb automatically and it's working crazy good.

blissofbeing 5 hours ago||
I've been using Wispr Flow on my pixel 9 and I like it. It does the things that Rambler says it's supposed to do but it's available on my Pixel 9 unlike rambler that's currently only available for pixel 11.
film42 8 hours ago||
Curious if this suffers from the same hallucination problems as Chirp or not. For example, if you pass chirp some audio with noise or even no audio, it will barf text at you like "I don't know. I don't know. I don't know." until a request timeout fires after like 10 minutes. It's... really bad. For this reason, we've moved back to Whisper for timestamp accuracy and then Gemini Flash for transcription correction.
sync 6 hours ago||
I eval'd this pretty heavily with no audio or just noise, as for us hallucinating a response is very bad. It works great in this scenario. There are some bugs, e.g. randomly exactly 20 seconds of silence will lead to a 403, but I'm sure these aspects will be improved over time. I didn't get any hallucinations though.
wolvoleo 7 hours ago|||
I've seen Whisper do this exact thing as well. And also repeating a few words over and over near the end, words that were said but not completely at the end. It seems to overwrite the last few sentences with that so actual content is lost. It's really annoying especially because Whisper is really quite good otherwise. Sometimes a friend sends me audio messages from a noisy car and I can't make it all out but whisper gets it mostly right.
k9294 7 hours ago|||
I am using it all day as a main dictation model, and I can say it's the best model in terms of accuracy, latency, and formatting I have ever used.
erulabs 6 hours ago||
mind if I ask what dictation tool you are using?
tech234a 3 hours ago||
I’ve noticed the some of YouTube’s auto-generated captions will sometimes hallucinate “Heat” during long music segments; probably an older model though.
gumby271 9 hours ago||
That's really impressive! It says it's available in GBoard on Android but I don't see it yet. I assume like most Google features it will be a rolling release over the course of several months, can't wait to try it some day.
bahmboo 8 hours ago|
It is confusing. As far as I can tell "rambler for Android" is a named subfeature of gboard and only on Pixel 10+ and newer Samsung phones. From a user standpoint it "just" seems like the transcription has gotten better - not an app you use or a feature that you enable.
satvikpendem 2 hours ago|
Still no real time diarization beyond 3 people (and even then experimental) when others do it very well, like Soniox and Deepgram. For something like meeting notes this is critical. Not sure what the issue is to implement it, maybe that's not Google's use case in mind and rather it's about personal Rambling as the feature on Pixels shows, which uses this model.
selcuka 2 hours ago|
> maybe that's not Google's use case in mind

That would be interesting when they also own Google Meet.

satvikpendem 58 minutes ago|||
Yes, I specifically avoided mentioning that because they don't need to diarize from audio directly as they know exactly which participant is speaking at all times.
mrkstu 2 hours ago|||
They have access to each individual’s stream in that case in order to diarize.
More comments...