Why are the major AIs so terrible at learning? It seems like things like self-driving cars could be solved over a long weekend (about as long as it takes to teach a kid the basics of driving) with a great learning model.
Basically we started tuning them to be smarter and able to handle 2 to 4 hour tasks.
I believe this will hit it's limits as well. When IDK.
Just to have a shared example of AI text, this is pretty instructive I think: https://statmodeling.stat.columbia.edu/2026/11/21/by-program...
Where a human would write "by the end of the program" the model (feels like Claude to me but idk) writes "by program end". Where a human would write "There are two scheduling considerations for program hosts." the models writes "Two timing windows worth flagging."
The latter text, "two timing windows worth flagging" is highly specific and precise if you're a model keeping track of something in the docs of a repository across contexts, but it's terrible human communication.
On long term tasks, "CoT + RL" of o1/o3 beats GPT-4.5 resoundingly. But on raw base model perplexity, GPT-4.5 is a significantly better model than any of the o-series.
The curve following GPT-4.5 and o-series suggests that newer models take advantage of BOTH better base model capabilities (perplexity on held-out data) and better RL.
That generates new data that's not on the Internet -- more true observations to learn from, compress, and generalize.
I think that improves the models in general, not just for agents. (And also I think it's the cause of the "Claudish" prose dialect we all started noticing)
I think that matches the timing, though I appreciate any closer analysis
So "useful coder" arrived about three years earlier, by my count.
The post makes a good case that at frontier scale this doesn't matter much, because perplexity gains turn into new capabilities. However, this has been an issue for me when training local models
Some agents wanted to optimize for perplexity, and we did all kinds of experiments, but at least for what I wanted (a small conversational chat model that can run in my browser, ~8M params), that was the wrong way to go. I could get excellent ppl numbers, yet still almost no coherence
What worked best, in my case, was to get better data, specifically, hand-crafted examples for the tasks I wanted the model to be good at. I'm guessing that perplexity might track capability when the model is big enough to turn the gains into general skills, but at a few million params it mostly buys you better-sounding word statistics
In other words, there is only so far you can go with the model of a given size before needing to increase it for smaller incremental gains.
Nah, just kidding.
The labs are training their models on the previous' version conversations, but I'm sure not all those conversations are weighted equal. So there are some conversations that are more "sparky", where both LLM and human work better towards achieving a solution. The next LLM iteration learns from them. In that sense, they don't need to hallucinate, but to do exactly what LLM dissenters say they do: "they just regurgitate something they saw (trained on) somewhere". To us humans, who haven't read all the books nor experienced a dozen million successfully completed tasks, that "rehashing of knowledge" (I prefer "recombination of knowledge") is more than good enough to solve ever more challenging problems...at least as long as there's a human in the loop with ever bigger ambitions.
There's also the Hilberg model where the entropy rate keeps falling towards zero as you consider longer and longer texts, and at least here (https://www.youtube.com/watch?v=5eqRuVp65eY) data from LLMs showed no floor. It would be unintuitive if it turned out that you can compress sensible English text to, say, O(sqrt N) length!
[1]: https://www.interconnects.ai/p/elicitation-theory-of-post-tr...