Top
Best
New

Posted by swolpers 6 hours ago

Gemini 3.8 text-to-speech(blog.google)
213 points | 108 comments
rcr-anti 3 hours ago|
Pet peeve on Google's AI rollouts: there's no alignment across the three platforms they have, consumer, prosumer, cloud. Scroll to the end of every release, including this one, and you'll see different availabilities. The fun part is the models don't even have the same capabilities across platforms! Omni Flash, last I tried and read the docs, is video and text out on consumer and prosumer but video out only on GCP. So if your org disables consumer and prosumer, like mine, it's a coin flip whether you can use the fancy new models or what they can do.
Melatonic 1 hour ago||
Seriously. It's very annoying. Add to that the corporate Google Workspace also getting models later
deepfriedbits 1 hour ago||
It is and frankly, it's always been a Google weakness.
buredoranna 1 hour ago|||
> Pet peeve on Google's AI rollouts: there's no alignment across the three platforms they have...

just remember: despite they would have you believe they are are a united front... they are better thought of as a "loose federation of warring tribes".

xattt 1 hour ago||
An education account I have lists 3.1 Pro, and 3.6 Thinking and Flash as the available models in the app.

My personal account, 3.6 Flash Lite and 3.5 Thinking.

Meanwhile, I can go hog wild and drain my bank account on GCP. I don’t though, because my family has to eat.

simonw 5 hours ago||
> Voice replication: Recreate consistent vocal profiles from just a 30-second audio sample of your voice or a voice you have the rights to use, backed by built-in consent verification, SynthID watermarking, and C2PA credentials to protect both developers and their vocal talent.

I guess voice cloning is widely enough available now from other providers that Google are no longer hesitant to ship it.

kingstnap 3 hours ago||
Yesterday night I was doing a project with QwenTTS 1.7B.

After some debugging, making a clean dataset with clean recordings, and experimenting with a good fine tune recipe (much props to the new GPT models yesterday being cheaper).

I was able to make a robo-me that sounds absurdly good, family was shocked, all in a matter of a few hours.

So yeah the cat is out of the bag for sure.

MacNCheese23 2 hours ago|||
Yeah I was doing that at the beginning of this year with voice samples locally from hollywood-stars with Qwen3-TTS.

It took like 1min - capture something from a youtube or video and put in your own text. It worked also really good for a german test.

Made a voice message for my wife from one of our favorite actors, telling here how nice it would be to make some breakfast :D

rpastuszak 40 minutes ago||||
Any chance you could share a bit more detail? I’d love to try this myself but could use some proven structure / approach.
stavros 1 minute ago||
Same, I'd love a link.
yieldcrv 3 hours ago|||
Its so crazy to me how prevalent bad AI voices are, when local models can do such good AI voices
spuz 18 minutes ago|||
Arguably, no AI voice should sound like a human voice:

https://youtu.be/M-IVVJkZnuo?t=236

pixl97 2 hours ago|||
Very few people explore the options they have and tend to stick with the first thing that works.
Multicomp 5 hours ago|||
They probably do something similar to GPT-Live where they expect a given voice profile to send them a sample saying 'This is the owner of this voice and I consent for synthetic samples to be made of it'

and/or local voice cloning is good enough as is so Google doesn't grant a uniquely liable ability?

gruez 4 hours ago||
>and/or local voice cloning is good enough as is so Google doesn't grant a uniquely liable ability?

Probably the latter. Cat's already out of the bag to the extent that you can synthesize with a specific voice in one go and it sounds decent. Even if you need commercial models for better intonation or whatever, you can probably get the commercial models to first generate with a generic voice, then use a local model to transfer that to voice you're cloning. That'll probably get rid of any C2PA watermarks too.

throwa356262 3 hours ago|||
This has been possible for quite a long time (probably 1-2 years). There are multiple open models that can do this quite well. Recent example from my YT feed:

https://m.youtube.com/watch?v=WENMgQE9tws

miltonlost 5 hours ago||
[flagged]
imjonse 4 hours ago|||
voice cloning is a tool, it is not necessarily evil, even though the scenarios it can be used for nefarious purposes outnumber the legitimate ones.
bakies 4 hours ago||
is the legit ones just like... putting carrie fisher in star wars?
gegtik 4 hours ago||
usually people bring up anyone who is losing physical control of their voice faculties, so they can have a synthetic voice that matches their natural voice
jolan 4 hours ago||
As an example of this, Sarah Langs uses a synthesized voice due to the progression of her ALS symptoms.

https://en.wikipedia.org/wiki/Sarah_Langs

simonw 4 hours ago||
The iPhone has a built in voice cloner hidden in the accessibility settings for exactly this use-case: creating a backup of your voice in case you need it in the future.
kmoser 4 hours ago||||
Google granted themselves the authority be evil back in 2018. https://en.wikipedia.org/wiki/Don%27t_be_evil
hbn 2 hours ago||
It's still in their code of conduct, as the wikipedia article you linked mentioned

https://abc.xyz/investor/board-and-governance/google-code-of...

ctrl/cmd+f "evil"

I don't know why this argument is brought up all the time anyway, it literally means nothing. They can name themselves "Don't Be Evil Inc" and continue to do evil stuff cause evil isn't an objective measure. If squeezing juice out of puppies made money, any business can just say it's "not evil."

And if you think they're evil why would you trust them to follow their own guideline of not doing evil? An evil corp would be more likely to just hide behind that phrase, not quietly remove it as some subtle hint that they want to be openly and proudly evil all of a sudden.

gruez 4 hours ago|||
I mean yeah? If google offers a cloud nmap tool, should everyone get in a tizzy about how google is "evil", even though it saves baddies maybe 5 minutes of work?
thangalin 5 hours ago||
Here's a video of my Emotive Audiobook Creator, KeenLore, a locally hosted web app:

https://www.youtube.com/watch?v=WAeHgE94rVo

No cloud, no tokens to pay. Reads a book using a full cast of characters. Quotation attribution detection (for my novel) is at 97.2% accuracy (485/499 quotes identified and assigned correctly). The autofill of character voice descriptions uses the prose to determine how the character sounds.

Employs Gemma 4[1] for the prose analysis (voice fills, quotation detection) and Qwen3 TTS Voice Design[2] for creating voice samples. Runs on an 8GB NVIDIA T1000 GPU card, 96 GB RAM, and a AMD Ryzen 5 7600.

[1]: https://deepmind.google/models/gemma/gemma-4/

[2]: https://huggingface.co/spaces/Qwen/Qwen3-TTS-Voice-Design

RGS1811 45 minutes ago||
I've been working on a similar project all year and as a tip, you should try Fish Audio or Higgs as a replacement for Qwen3. Both yield much better prosody and are much easier to listen to for long runs.
loremm 5 hours ago|||
It's cool technology and I read a lot of audiobooks, even hundreds of hours of TTS. I feel like my brain can fill in the character voices from the text - on the page it's not like they're different fonts.

I understand audiobook narrators often do it, and that's fun. But it's not so critical in my opinion

eru 2 hours ago|||
Awesome! I had been meaning to build something like this for a while now, but never got around to it.

Is it possible to annotate your text with extra 'stage directions' that influence how the book is read out?

thangalin 2 hours ago||
> annotate your text with extra 'stage directions'

Good idea, not something I've considered yet. Wouldn't take much to add it since there's already a feature for selecting a quotation and assigning it an intonation. Same infrastructure could be reused to select arbitrary text and assign stage directions.

Multicomp 5 hours ago|||
<grumble grumble people putting in links they expect you to follow to arbitrary goatse youtube videos for all I know>

The title of the video is 'KeenLore - Emotive Audiobook Creator Demo' and it appears to be a web UI and some local stack that reads text files.

Jordan-117 4 hours ago||
Their first sentence literally tells you it's a video of their app? It's not a mystery-meat link.
talon8635 5 hours ago||
[flagged]
idiotsecant 2 hours ago||
I guess I should feel bad about wanting to listen to audiobooks of novels that don't have audio while I drive
Multicomp 5 hours ago||
I direct my own extended daydream Star Trek fanfic (okay, I'm on season 2 episode 17) and recently I looked to see if I could have each scene file be read aloud a la an audiobook or radio drama.

Getting GPT-Live to have unique enough voices and to be expressive with how I imagine the voices going in my head is hard to direct, there's not enough control there.

So this Gemini 3.8 specific large voice library and ability to tightly control (if you are willing to write a script) is nice to find, and while I'm not sure which of the 5,286 Gemini products this is, nor how to onboard and get started feeding this my own text files, nor what training will happen to my data if I did somehow use it, I love that the state of the industry is such that Google can do this and release it publicly, because that means eventually an equivalent product can come from someone else and be used locally / confidently that the generated audio or inputs won't be retained and misused.

exhilaration 4 hours ago||
You might find this interesting, it seems to be exactly what you need to make an audio drama: https://github.com/Finrandojin/alexandria-audiobook

Also the Qwen3-TTS demo is cool, you can describe the voice you want: https://huggingface.co/spaces/Qwen/Qwen3-TTS

I came across both on this subreddit, it's very active: https://www.reddit.com/r/TextToSpeech/

I'm personally using this locally: https://github.com/mateogon/pdf-narrator (it's a Python frontend for Kokoro) on my M1 Macbook Air (from 2020, with 8GB RAM) and it's incredible. I make my own audiobooks now - for free!

My favorite voice is am_michael and here's a sample: https://voicerankings.com/voice/kokoro-82M/male/am_michael/s...

throwa356262 3 hours ago|||
Then I think what this guy is doing with local Star Trek voice cloning is right up your alley:

https://m.youtube.com/watch?v=jDudeaWppSE

ghostbrainalpha 5 hours ago||
Original series or Next Generation?
k12sosse 4 hours ago|||
Lower decks obviously
hungryhobbit 4 hours ago|||
Please don't say Nu Trek.
seemaze 4 hours ago||
My primary use case for TTS is converting written content (blogs, articles, etc.) in to clips I can listen to on the go.

Is there a good browser extension that does this with a flexible TTS backend? I know Qwen, Kokoro, and VibeVoice all have decent quality..

exhilaration 2 hours ago||
Browser extension? Try these: http://www.paper2audio.com/ https://freevoicereader.com/ https://chromewebstore.google.com/detail/sza-text-to-speech/... https://chromewebstore.google.com/detail/flow-tts/hknidankih...

I found all these on this subreddit: https://www.reddit.com/r/TextToSpeech/

I've also see comments like "Microsoft Edge's read-aloud feature is amazing for TTS" but I haven't tried it myself.

Personally I use Kokoro with a python front-end on my Macbook, I linked to it in this comment: https://news.ycombinator.com/item?id=49818923 it outputs MP3, so I just copy those to my phone and listen as audiobooks.

kyrra 4 hours ago|||
If you use Chrome on Android, there is a "Listen to this page" option in the menu.

https://support.google.com/chrome/answer/14768725?hl=en

e12e 1 hour ago||
Doesn't actually read the page, though. Or not what you see in the browser. For example right now, when I navigate to "reply" it doesn't read the comment I'm replying to - it's reading the login banner you get visiting a reply link without being logged in.
unglaublich 4 hours ago|||
I vibed a wikipodcast app that has a wikipedia dump, gemma llm for search and summarization and a tts model for audio gen so I could just ask about topics while on the go, and the app would just go off and tell me stuff out of the Wikipedia database.

It was especially nice during a bike trip along the Rhine, I listened to a lot of the history of the industrial area and its cities.

janalsncm 4 hours ago||
For on the go, I’ve been using ElevenReader. Technically not free but their free tier has been plenty for me.
accountrequired 4 hours ago||
"users must provide a verbal consent recording from the voice owner that matches the reference speaker before a voice can be created"

How long is this stored? What could go wrong? :P

kmoser 4 hours ago|
Does it detect synthesized consent recordings?
pixl97 2 hours ago||
There is no world in which something like that works over a few months.
nater5000 4 hours ago||
It's giving me an error when I try to generate a voice with Voice Design in AI Studio. It also says voice replication isn't available in my region.

Also weird that there are no "neutral gender" voices in the English language. There's also limited "use cases," like the "Gaming" use case is empty?

And there's no pricing listed anywhere.

I don't know, I guess their roll out is a bit sloppy. It's a bit of a shame, though, since the voices which are available all sound like generic Gemini voices to me. Nothing stands out is being particularly interesting or impressive about this.

Thaxll 3 hours ago||
What is the best open model / tool for text to speech running locally?
rhdunn 3 hours ago||
It depends on what you are after (quality, legibility, performance, etc.).

If you're after quality then Qwen3 TTS is a very good model esp. if you take some effort to craft a voice file. It is slow, so isn't practical for real-time voices (like assistants). It can also occasionally switch to a different voice to the one provided, so you may want to break up the text being processed.

I've not yet tried other recent/recentish models.

If you are after performance then two options from older models are:

1. flite with a HTS (Hidden Markov Model) voice like cmu_us_rms (male) or cmu_us_slt (female);

2. espeak/espeak-ng with an MBROLA (an Overlapped Add model) voice (mb-us1, mb-de5-en, etc.).

Alternatively, you could try using Qwen3 TTS or over voice changing model with the CMU Arctic (http://www.festvox.org/cmu_arctic/) voice data which includes audio for the rms and slt voices among others.

If you're feeling adventurous you could also try fine tuning one of the TTS models on that data to create a custom voice, though the data is likely to be in the training data for the voices, so using an audio sample may be sufficient depending on the TTS model.

VariousPrograms 3 hours ago|||
I've got the best results with BreezeTTS, Higgs Audio v3, and Fish Audio S2 Pro. audio.cpp (https://github.com/0xShug0/audio.cpp) is an easy way to run a lot of different models.

Different models have different strengths. If you throw an entire ebook at a model you're going to get a different result than if you craft a perfect 10 second sentence with a model that supports voice direction and emotion tags, so you should try a bunch depending on your use case.

freedomben 3 hours ago|||
I've been making audiobooks out of text files that I have lying around, and kokoro TTS has been phenomenal
x3haloed 3 hours ago||
I love PocketTTS. It's stupid fast and the voice quality is decent. But it's not the highest quality.
simonw 4 hours ago||
I vibe coded a playground UI for trying this out. The conversation mode is neat, and it's very expensive - most of my experiments have cost less than a cent.

https://tools.simonwillison.net/gemini-tts-playground#compos...

simonw 34 minutes ago||
Example (topical, pelican themed) audio clip here: https://simonwillison.net/2026/Sep/23/gemini-tts-playground/
mohsen1 3 hours ago|||
Why tho? AI Studio has this model available and I don't need to paste the API key anywhere

https://aistudio.google.com/generate-speech?model=gemini-3.8...

simonw 3 hours ago||
Because building my own is a better way to understand the capabilities of the model and how to use it - and to verify that it can be used via CORS.
iAMkenough 4 hours ago|||
Very expensive?
simonloserson 3 hours ago||
he's vibe writing
eis 3 hours ago||
Nice but in general I wouldn't put my API key into some third party website, no matter if it claims to not store it. It's not something personal, you are a bit of a celeb here so I wouldn't think you'd save the keys, it's just good general data hygiene. Especially not if a leaked API key can rack up thousands of dollars in fees quickly.
simonw 3 hours ago||
Sure. Feel free to copy the code and run it yourself instead.
dangoodmanUT 43 minutes ago|
In their demo for "Monologue" (2nd video over, after the medeival video game example), it is clearly ignoring the vocal cues like `<chuckles>` and `<laughing>`...
More comments...