ppl are doing all sorts of gymnastics to tell claude to slow its roll with verbosity.
bkd9 3 hours ago||
Author here. I made these plots because I had been searching for them for months and never found quite what I wanted: how the cheapest way to reach a fixed capability level has moved over time. Artificial Analysis publishes enough data to reconstruct it. If someone knows of a source that already tracks this, with historical prices, please share.
jnwatson 31 minutes ago||
The animated Pareto front graph by time is truly inspired. Well done!
brabel 2 hours ago|||
It blows my mind how fast models are getting better and this is the first article I’ve seen that shows just that and leaves almost no room for disagreement. Well done.
andai 2 hours ago||
Thanks for the effort you put into this.
I wonder if it might drive the point even further if the graph scales were linear? Or maybe the progress has been so great that this would make the graphs unreadable?