Posted by karpathy 10 hours ago
Only 12 upvotes - I guess his name wasn’t Karpathy.
The product isn’t really that interesting, but it’s been built by a nerd celebrity so people gush for it and upvote it.
You see the same thing with blog posts all the time: some “celeb” posts an average, run of the mill take that plenty of people have had before them and only now it’s suddenly relevant and insightful, with people thanking their celeb for sharing some amazing basic idea that has been shared countless times before by other people.
Steve Yegge is another one I see a lot. These folks could fart and it’d reach the front of HN.
In your video regarding your own use of LLMs[1] you mention https://arena.ai/leaderboard and https://labs.scale.com/leaderboard to keep track of the status quo. That video is from February 2025 and https://artificialanalysis.ai has gained quite a lot of popularity but also earned criticism repeatedly due to updating the benchmarks right before a new model release. Would you still recommend the arena and scale leaderboards? And if you don't mind, what's your opinion wrt artificialanalysis?