Top
Best
New

Posted by cmrdporcupine 1 day ago

Mercury 3: Diffusion at scale(www.inceptionlabs.ai)
255 points | 91 commentspage 3
vatsachak 1 day ago|
Not as fast as GPT 6.1-Sol on my favorite toy math puzzle. It might be one of those things where intelligence consumes less tokens
camdenclark 1 day ago||
Looks excellent, looking forward to trying this out. Feels like we're reaching a critical point where these become competitive.
moonu 1 day ago||
I really wish they would make these multimodal. Seems like a definite improvement over 2.5 though in my testing
lemontheme 16 hours ago||
One of the few LLM announcements I still get excited about. dLLMs have so much potential. See, for instance, how gemma diffusion can be repurposed as a decision model with output tokens and diffusion steps set to 1.

The guardrails are ridiculous though:

PROMPT:

> Draw an ascii diagram illustrating how to leave a two storey building in the event of fire

ERROR RESPONSE:

> I'm sorry, but I can't help with this because it involves potentially dangerous or harmful content. I'm happy to help with something else.

Come on

prometheus1992 1 day ago||
100M free tokens? wow.
jjaskulowski 1 day ago||
Any comparision would make sense only if you made them - Mercury and Luna - the same training data and then the same post process, alignment. It's nice it's fast. I support it. Just saying I don't know how to judge that.
esafak 1 day ago||
I wish they had a coding plan so your could kick the tires before paying API rates.
cmrdporcupine 1 day ago||
"Quality: On par or better than frontier speed-optimized models like GPT-6 Luna and Claude Haiku 5.5. Speed: 1,068 tokens per second on NVIDIA GPUs. Context: 1M tokens, up from 260K for Mercury 2.5 Price: $0.20 per million input and $0.70 per million output tokens. At launch, Mercury 3 is 50% off at $0.10 per 1M input and $0.35 per 1M output. Cached tokens are 90% off the input price."
volodia 1 day ago|
Hi HN, this is Volodymyr, Inception Co-Founder & Chief Scientist.

Today we're launching Mercury 3, our most capable production diffusion LLM.

Quality: Outperforms GPT-6 Luna and Claude Haiku 5.5 across a range of benchmarks at matched reasoning effort. Speed: 1,000+ tokens per second on widely available NVIDIA Blackwell GPUs, 4–8x faster than those models. Context: 1M tokens, up from 260K. Price: $0.10 per million input and $0.35 per million output tokens at launch.

The main takeaway is that diffusion scales. Since Mercury 1 we’ve scaled the model more than 40x in total parameters, and intelligence has gone up at every step without giving up speed. Diffusion generates tokens in parallel through iterative denoising rather than one at a time, so as reasoning models think longer per answer, the speed advantage over autoregressive models of the same size grows.

Early-access partners are running Mercury 3 in browser agents, tutoring apps, real-time search, and customer support. It’s OpenAI API compatible, and it’s also available on OpenRouter, Baseten, and Vercel.

Try it on our API with 100M free tokens.

Happy to dig into the architecture, scaling results, evals, or anything else in the comments.

ttul 1 day ago||
I'm curious if you could comment on why your DeepSWE performance is below Haiku. This is not a dig - getting 46% vs. Haiku's 52% is still amazing. I'm just wondering if perhaps your post-training was less aggressively RL'ed on coding tasks than perhaps Haiku was. Having a cheap 1,000 tok/s option for coding work is a dream because - if it's reliable enough - you could blast through work such as high-level security reviews or finicky and repetitive refactorings that don't necessarily require SOTA performance.
volodia 1 day ago||
We might not be able to precisely explain the 6% difference on that specific benchmark, but overall we have found the model to be Haiku- or Luna-level in our own daily usage. That means that it won't yet replace Opus or Fable as the primary driver of a harness, but we have used it successfully for subagents, including implementing kernel optimization ideas produced by a larger model (and those improvements have gone into production -- a form of RSI).

In general, the model continues to improve when given additional high quality data like a normal LLM, which is what makes us very bullish on the scaling of dLLMs.

ttul 10 hours ago||
Super cool. I'll have to give it a whirl! Keep up the amazing work.
LarsDu88 1 day ago|||
Google's research showed some of the speed benefits tended to drop off at larger batch sizes on an H100. Are there published batch-size vs tokens/s figures for Mercury 3?
volodia 1 day ago||
We've been happy with how performance has scaled with batch size. The model runs in our API at reasonable costs, which is also what allows us to serve the model with competitive prices ($0.10 per 1M input and $0.35 per 1M output at launch).
LarsDu88 1 day ago||
Pricing can always be set at a loss, however, particularly for a private company. Are there solid published numbers for a specific hardware spec?
jacquesm 1 day ago|||
Will you make the weights available?
volodia 1 day ago||
Not at the moment, but we are looking to share more information about the model in the future via technical blog posts and technical reports.
jacquesm 1 day ago||
Ok. Good luck then.
AmazingTurtle 1 day ago|||
Whats the model total param size and will you release the weights? What does harness integration look like? Do you have an harness? Is it good at coding? What about tool calls? Do we have to wait a fixed amount of time for every step it takes?
volodia 1 day ago||
We're not releasing the weights, but the model is available using a standard API, and it integrates with your favorite harnesses.

Here is a page that compiles the list of integrations: https://docs.inceptionlabs.ai/integrations/overview

For example, it's just a few small steps to run the model in Cursor: https://docs.inceptionlabs.ai/integrations/cursor

You shouldn't expect Opus-level performance yet, but early testing has found the model to be great for coding subagents.

johanyc 17 hours ago|||
https://openrouter.ai/inception/mercury-3#performance

It seems the latency is not very good. Is this a temporary compute problem or is it inherent to diffusion?

himata4113 1 day ago|||
Why medium in benchmarks? I've not seen that many people use other than xhigh/max on the cheap models. No low->max performance curve either. Time to task completion would also be nice!
volodia 1 day ago||
We are going to be sharing additional information like task completion times in the near future as the model undergoes additional benchmarking by third parties. We also plan to share data on specific use cases where the model traces new points of the Pareto frontier and and speed cost.

For a preview of the latter, check out our analysis of the Mercury Voice model: https://www.inceptionlabs.ai/blog/introducing-mercury-voice

0xb0565e486 1 day ago|||
Incredible. Any luck in having a model that's multimodal in the future?
volodia 1 day ago||
This is an area that we're really excited about. We have internal prototypes, and if you're interested in trying it out as an early tester, please reach out to hello@inceptionlabs.ai
Topfi 1 day ago|||
If I may, are there plans for visual input support?
volodia 1 day ago||
We have internal prototypes, so please reach out to hello@inceptionlabs.ai if you're interested in early access
WithinReason 1 day ago|||
Is the model size secret?
volodia 1 day ago||
We're not publicly announcing the model size right now, but we can compare against other models with a similar intelligence -- what we see is a big boost in speed for the same level of capabilities.
lostmsu 1 day ago||
I don't see it on Baseten. Is it special in some way?
krooost 1 day ago||
https://www.baseten.co/library/mercury-3/
lostmsu 1 day ago||
Not listed among https://app.baseten.co/model-apis

Does it mean dedicated inference only?

krooost 1 day ago||
You have to reach out to Baseten directly for access. You can also access through our API (https://platform.inceptionlabs.ai/) or OpenRouter.