Top
Best
New

Posted by cmrdporcupine 1 day ago

Mercury 3: Diffusion at scale(www.inceptionlabs.ai)
255 points | 91 commentspage 2
SillyUsername 1 day ago|
Damnit, I've been waiting on an open weights model like this one, still no dice :(
discobot2 1 day ago|
diffusion gemma?
SillyUsername 1 day ago|||
It pretty bad. Just ask it to quote something like the first paragraph of moby dick (i.e. "call me ishmael...") it barely gets past 5 words before it completely gets it wrong. Even the worst normal 4B models get 3-5 sentences.
gessha 1 day ago||
That’s because diffusion models struggle with memorizing sequences while it’s essentially what autoregressive models excel at.

I’ve tried to fine tune a diffusion model to memorize an MD5 hash and after days of hacking on it, it failed to completely memorize it. Autoregressive models of any size learn it over <1000 iterations.

UncleOxidant 1 day ago|||
Was mostly an experiment. You're not going to use it for any real coding. Hopefully we'll see another updated diffusion gemma in the future.
ilitirit 1 day ago||
I've been trialing this for the last few hours. It was quite slow at first, but now I'm getting around 300-400tps. Still nowhere near 1000tps, but it's still incredibly fast compared to what I'm used to with other models. It's quite capable as well. I asked it to present strategies for training an AI to play fighting games and it gave quite well-reasoned output. It searched the existing my existing knowledge base for details about the game's internals, including record/playback, and it's own general knowledge about the game is played. It wasn't sycophantic about my opinions either - it challenged me appropriately.

I think they might have a really decent model if they can deliver their advertised speeds at scale at reasonable prices. A tiered approach could work well.

snake_doc 1 day ago||
Hmm at least in Openrouter, deepseek v4.1 flash via together/baseten/fireworks still beat mercury 3 on latency and intelligence

Ttft is quite slow with mercury

minraws 1 day ago||
I created a pelican worked wonderfully, better than old haiku model or even sonnet models, maybe slightly worse than new gen models.

But overall it's a pretty ok model, the issue with speed seems to be that ttft is still high but still not sure how high thinking burden would be, I hope it scales well will be using it a lot if it works well.

This might actually crush most other LLMs if it's price and performance actually scales well. It was as cheap as deepseek for a few tasks I tried.

Anyone know if there is a subscription for it? I might want to test it out properly without burning a few hundred dollars on it.

2001zhaozhao 1 day ago||
I have liked diffusion models for quite a while, ever since i used the original Mercury to play AI Roguelite. I only have one question regarding Mercury 3: how tf did they get it to be so cheap?

If these benchmarks hold up it is a no-brainer against Haiku 5.5 and GPT-6 Luna, especially considering that Haiku 5.5 becomes 5x more expensive past 100k context, and this model goes up to 1M for the same price. (Note: the price increases 2x after a period post launch but is still way lower than Haiku is priced for >100k requests)

fraywing 1 day ago||
Are these models harder to reason about given they produce tokens non-linearly? Especially since we rely on non-latent reasoning to know what the model is "thinking".
carterschonwald 7 hours ago||
its definitely good at admitting when it doesnt understand stuff. which is a rare treat with these models.
arendtio 1 day ago||
Having a chart with a linear scale on one axis and a log scale on the other axis is a really neat trick.

The resulting charts have a high probability of looking fantastic :-D

davedx 1 day ago||
I wonder given its speed how competitive it would be with the current batch of decision models like Jev et al. Seems to me for decision models you really want maximum throughput.
moonu 1 day ago|
They have a separate decision model called Mercury Decide
moecables 1 day ago|
I'm going to start using this instead of Haiku/GPT-Luna for tasks that require speed.

I'm wondering if it'll still be useful once the discount is lifted?

cubefox 1 day ago|
I have trouble thinking of tasks that "require" this kind of speed. The usual trade-off is between price and quality/reliability.
krooost 1 day ago|||
Speed matters most when people are waiting for a response, when information loses value by the second, or when agents make dozens of calls to complete a task.

Customers are already using Mercury 3 for browser use agents, interactive education, real-time search agents, customer support, and more.

svachalek 23 hours ago||||
It's not really all that fast, for most things it's full seconds or at least a significant portion of a second. As computing goes that's quite slow and there are many things that require much faster speeds than this. However compared to the typical LLM it's quite speedy and opens some new doors for real-time-ish scenarios.
moecables 1 day ago||||
in my case, I'm hoping that the time-to-first-token isn't so bad that I can have my admin users parse some information in the web ui pretty quickly (a very specific use case, i know)
dgellow 1 day ago|||
The time isn’t too relevant for let’s say coding tasks. But if you’re doing user facing, or processing live-data (logs for example) the speed becomes important
More comments...