Surely it's easy to verify by simply doing Benchmark tests every 2 or 3 days but not publishing them so they can't be gamed, then releasing all at once?

I for sure felt that this was the case for a while now, but couldn’t explain it. Newly released feels great for the first couple of weeks, but then it starts to get worse.

I'm always excited to run models on my local machine. I use Ollama for that.

Makes sense, no? Test time compute is something you can vary, so it makes sense that you start covertly reducing it once the model has already made it's splash.

How do you measure thinking tokens? They don't send those back to the client.

The NERF is finally established, this should be part of the ever growing benchmark maxxing.

I stopped reading when I realized the article reminds me of my own Claude-generated solutions at work - just an endless maze of special business logic on top of special business logic. You need an LLM to understand it. You need an LLM help write the documentation. You need an LLM to help read the documentation.

They want transparency from everyone else but not for them ... you don't say.

I strongly believe that the real Fable is the one we had for a few days in June. Then they nerfed the model a bit after the government pulled it off the market. What we have now is something less, but still good