Posted by cmrdporcupine 1 day ago
I’ve tried to fine tune a diffusion model to memorize an MD5 hash and after days of hacking on it, it failed to completely memorize it. Autoregressive models of any size learn it over <1000 iterations.
I think they might have a really decent model if they can deliver their advertised speeds at scale at reasonable prices. A tiered approach could work well.
Ttft is quite slow with mercury
But overall it's a pretty ok model, the issue with speed seems to be that ttft is still high but still not sure how high thinking burden would be, I hope it scales well will be using it a lot if it works well.
This might actually crush most other LLMs if it's price and performance actually scales well. It was as cheap as deepseek for a few tasks I tried.
Anyone know if there is a subscription for it? I might want to test it out properly without burning a few hundred dollars on it.
If these benchmarks hold up it is a no-brainer against Haiku 5.5 and GPT-6 Luna, especially considering that Haiku 5.5 becomes 5x more expensive past 100k context, and this model goes up to 1M for the same price. (Note: the price increases 2x after a period post launch but is still way lower than Haiku is priced for >100k requests)
The resulting charts have a high probability of looking fantastic :-D
I'm wondering if it'll still be useful once the discount is lifted?
Customers are already using Mercury 3 for browser use agents, interactive education, real-time search agents, customer support, and more.