A Man Out to Prove How Dumb AI Still Is

Posted by fortran77 4/4/2025

A Man Out to Prove How Dumb AI Still Is(www.theatlantic.com)

64 points | 63 commentspage 2

geor9e 4/5/2025|

I made a little viewer to see the dataset. Spoilers, it shows you the answers. It's mainly to see the mistakes they've fixed on GitHub since it was released, and also to make proposing fixes easier.

https://9eorge.com/arc

Supposedly, they validated it upon release by showing each task to at most nine people and only keeping the ones that at least two people got correct in two tries. But still, they have had to subsequently fix more than a dozen of them.

mdp2021 4/4/2025||

> A person who scores 30 percent on ARC-AGI-2 is in no sense inferior to someone who scores 90 percent

"News just in: journalist for the Atlantic stops reasoning and drifts in a world of feelings after neural hijacking, as he perceives abilities as some kind of threat".

> Human cognitive diversity [...] when that diversity is already so abundant, do you really want to?

We definitely need intelligence.

Yeul 4/4/2025||

Unfortunately I played Deus Ex religiously when I was a kid so I'll never be impressed with AI. The sequel had a self flying helicopter- good luck with that Tesla and BYD.

j_bum 4/4/2025|

> To hit 87 percent on the original ARC-AGI test, o3 spent roughly 14 minutes per puzzle and, by my calculations, may have required hundreds of thousands of dollars in computing and electricity

> the bot came up with more than 1,000 possible answers per grid before selecting a final submission.

Yeah, AGI is right around the corner… /s

HenryBemis 4/4/2025||

Let's all hope two things: 1) AGI is not near 2) Nobody ever allows it to have physical presence 2b) should that happen, expect the one idiot ask it to make "as many paperclips as possible" :)

pixl97 4/4/2025||

I also remember when a computer about as powerful as the watch on my wrist cost millions of dollars and filled multiple large rooms.

j_bum 4/7/2025||

lol point taken.

I would be willing to bed we’ll see something rambling natural intelligence created in this century, but I think this brute force approach shows that we’re just not there yet.