why would xhigh -> max increase the cost but lowers the score on frontier 2.0 bench?

Seriously waiting for this one! Will try it asap.

Anthropic thinks that their models are smart, but not so smart so as to be able to fake responses to their alignment tests. How would they know again?

I can't believe he wasn't at top. Always is. Nothing to add but hey: I guess pelicans will be at the end of this.

God damn I'm tired of the fucking pelicans.

opus will be launch after astra 2

Every single time I click on these announcements the frontier model ALWAYS scores around ~60-80%. Every. Single. Time. Like, I just went back to the Opus 4.6 + 5 announcements, they were also scoring 60-80%.

https://www.anthropic.com/news/claude-opus-4-6 https://www.anthropic.com/news/claude-opus-5 https://openai.com/index/introducing-gpt-5-3-codex/

For every single announcement, not only do the top models always score 60-80%, the older models somehow start scoring 20-30% (even though previously they were scoring 60%). It's completely unclear whether the methodology changes, how these scores are even evaluated or which domains are being tested. What's worse is that the "benchmarks" keep being updated with no explanation or due process.

It's shocking to me that when I check threads for new frontier model releases on HN, it's full of people complaining. I, for one, am happy to see the frontier being advanced. These tools are life changing, and I'm extremely thankful for them.

Using this in CC and immediately getting a cartoonish number of compactions.

The disdain frontier labs have for their users really sucks.