And it again feels equally dishonest/bullshitty.
You can't really make an objective statement that coding requires multiple orders of magnitude more intelligence than having a conversation. And that solving math problems requires orders of magnitude more intelligence than coding.
It's just marketing talk. In reality all three are separate skills and the real intelligence requirements are, if you ask me, not that far away from each other.
To put this in an analogy, it feels like charting "athleticity on a log scale" and putting first running a marathon, then swimming across English channel, then benchpressing 200kg, each one presented as requiring an orther of magnitude being more athletic.
Where are you getting 'orders of magnitude'? and yeah I do think it's reasonable to say that Useful Programming requires more intelligence than the median human, and Solving millenium level math problems certainly requires considerably more intelligence than the median Programmer. What exactly is so absurd or unreasonable about that?
In the same way you could say that beating Gary Kasparov at chess requires more intelligence than the average human and yet we had an AI winter.
Essentially, Humans who tend to have higher verbal skills also tend to have higher spatial skills, better memories, and faster processing speed. Someone with the cognitive ability to become an exceptional chemist might just as easily have become an exceptional mathematician or software engineer (all else being equal).
The knowledge and skills required are obviously different, but the underlying cognitive abilities that make someone successful in one intellectually demanding field often transfer to others.
Then talks about cross-entropy but fails to explain the relationship between entropy, log-perplexity, and perplexity itself.
For an argument that relies so heavily on a quantitative metric, omitting such a fundamental explanation is poor.
Is there a public link of all their models and where they fall along this or is this cherry picking points to fit the curve?
Or the training set might just grow to be so big, defining a truly independent evaluation set is almost impossible.
I would expect the entropy of artificial datasets to be lower, thus easier to predict and scoring better on "perplexity"?
https://github.com/opendilab/awesome-RLVR
Examples:
- When playing Go or chess, nobody may have written or published web pages with a particularly clever end game, but an agent can use CPU time to discover these games themselves, and learn from them. Human Go players report learning strategy from what AlphaGo discovered.
- Agents use Unix shell and are trained with it. So they can discover things and combine things that nobody has written about on the Internet, like how to debug a rarely used driver, or an interaction between two drivers. And they can see patterns in all the drivers that humans may have a hard time even seeing, leaving aside the motivation to publish on the Internet.
This explains why the performance is so "jagged" - great on coding, math and closed games, but less good on things involving the real world. We probably did hit a data wall, but then we got new sources of data.
- the row of the move;
- the column of the move;
- the piece moved;
- any special/additional states from that move -- check, checkmate, castle, etc.;
- maybe an indication of whose turn it is (i.e. a black piece and a white piece token).
You could then train the base model on published game transcripts and use the interactive RL approach like AlphaZero and LeelaChess use, as well as what you mention for LLMs.
Why this is interesting is that it should give insights into how LLMs/transformers learn Chess/Go without having other data affecting the results. Specifically whether the token semantics identify valid moves, etc. and whether the context window encodes gameplay strategies across the different layers.