based on Jev's Doom demo it should be ready for this test

I'd have started with an RC car but to each their own

Super cool benchmark!

Not stick tho...

This is what I first though of after I saw the drawing tool use demo. Right now we have specific AI that can generate images and drive cars, but tool use shows a process oriented AI that can use tools to drive a car, like we use our eyes/hands/feet. It's process, not task, that matters for AGI. And I think for artistic collaboration you just want something that knows your process deeply.

I also think the big data approach will never quite reach their goal. There will always be a wall infront of your goal that you will never be able to cross even with infinite data. An LLM isn't good because it generates a really kick ass token, it's good because it generates a lot of good tokens, and the system around it manages the context well enough so it doesn't get confused.

Don't be so quick to downplay process oriented AI due to latency

good. i'll get it to drive my 4 runner

This is cool and definitely interesting, but the title is really overselling what the authors are trying to demonstrate. Astra can "drive" a car at ~.42 m/s within a set of boundaries that are 2-3 times the width of a normal lane, on a closed course, with 0 unexpected obstacles, in dry conditions, in daylight for $7.74. And unless you start and then stop every few seconds while driving, this is barely considered driving. Still very cool and an interesting benchmark!

It's not even 18 yet

Tesla FSD has been trying to kill passengers for a decade now

and that's dedicated machine-learning for a decade

still throws the car across traffic leaping at shadows

but please proceed, should thin out the population nicely

(Mercedes and BMW don't have this problem and are L3 because they actually have lidar)