So Neon is the new default, and Carbon the slow deep thinking “when you need it”? A bit like how Opus 5.5 was better than Fable 5.1 in most things, but Fable still had the edge over deeper things (then 5.2 came along)
Hydrogen has already became my default for 80% of small tasks. If Neon is as fast but smarter that would honestly be very cool
So I'd take their hierarchy with a grain of Sodium.
That spread is my personal bs detector for models over promising.
But I still can't understand the differences between these models.
Recently I watched Veritasium talking about helium, and I was thinking, will the effort setting of these models eventually have something like "Temperature K" to configure?
> We introduce Riemann-Bench, a private benchmark of expert-curated problems designed to evaluate AI systems on research-level mathematics that goes far beyond the olympiad frontier. Problems are authored by Ivy League mathematics professors, graduate students, and PhD-holding IMO medalists, and routinely took their authors weeks to solve independently. Each problem undergoes double-blind verification by two independent domain experts who must solve the problem from scratch, and yields a unique, closed-form solution assessed by programmatic verifiers.