I think the wine test was actually the part which blew me away the most. And they say it outperformed humans (albeit don't know if they were wine 'experts') on 19/20 tests?! Crazy work

It's not like they're training on that. That's just a good showcase of how the model is good at generalizing & understanding (not benchmaxxed). You might want something similar to these experts for tasks like detecting anomalies or discoloration or whatever.

What if your coding project is related to wine? So you would want facts about wine to be inside the weights, not through web search.

Just looking through the benchmarks, the model seems to be very high on visual/spatial capabilities. So I assumed they just tried some hard tasks on it and was surprised by wine identification and thought it was surprising that it could identify wines.

you want your coding models to have good taste, so we have fed them a vast dataset of sommelier wine gradings.

we've also contracted hundreds of local record store guys with deeply knowledgeable music taste spanning post-punk, classic jazz, early hip-hop, and deep-cut experimental vinyl. This has resulted in the model returning judgmental responses up to 23% more often which we are working on addressing.

You could probably run a Q2-Q3 with 2x DGX Sparks. So...$12k at today's prices. Plenty of folks are running DS 4.1 Flash with Strata and some GPU + bulk in system memory. Maybe more like $3k-$4k? But speeds come down quite a bit.

Mistral 4 IMHO is not that good. I have run the full NVFP4 weight, and I couldn't stomach it after 3 days of driving it. I went back to other models, I have more fun bouncing between DeepSeek, GLM, MiMo, Hy4, MiniMax & Qwen. If Thinkingmachine's self reported benchmark is true, I'm certain it's going to get into heavy rotation of my models.

Even when models score about the same, if you play with them long enough, you will discover capabilities that are unique to them. I have never see any 2 models that are comparable across every single area.

Because its american.

I would hope that the American models aren't benchmaxxed to hell like all of the Chinese ones are.