Anyway, I think it's good idea. Would love to see all models on this chart, but honestly we might not be able to trust it going forward as it becomes a target.
Domains like creative writing are harder as the automated grading suitable for autonomous RL is difficult (aside from spell checking and grammar checking).
Is it just me or does the article completely lack proof of this premise? I see a plot of perplexity dropping over time, with the implication that performance has risen as a result. This is just a correlation. What else did they change about post-training during this timeframe? This doesn't feel like a real experiment or real science.
I had trouble seeing it in the article (it's hidden in footnote 3) but it seems perplexity/log-loss is tracked using the model's ability to track an unreleased code base of OpenAI.
The log-loss involved in code has declined more for code than prose in all of the models but has supposedly declined everywhere. [1]
At the same time, the decline of the latest models on a common sense benchmark might be meaningful: https://news.ycombinator.com/item?id=50588916
[2212.11281v2] Language models are better than humans at next-token prediction https://arxiv.org/abs/2212.11281v2
We knew this many years ago. Like GPT 1 era.
Actually you can play it here. The game is pretty frustrating ngl. And I can clearly see why induction heads are a thing. Because when a word repeats you guess is to just guess the same thing from before.
Language modelling game https://rr-lm-game.herokuapp.com/
But when thinking, I’m fairly confident that our ability to predict the next few words of a book on a complex topic (in its words as opposed to the reader’s own words) is at best weakly correlated with intelligence or with subject-specific skill.
I certainly feel like I’ve learned a subject better when I can solve a problem differently from a solution I’ve seen before.