Top
Best
New

Posted by sandslash 13 hours ago

We ran AI agent swarms in Minecraft and Mindustry(labs.ycombinator.com)
288 points | 100 commentspage 3
avaer 11 hours ago|
If you try this yourself, it's obvious current models are hyperoptimized for code, and that gets in the way, because playing a game (or interacting with the real world) is not like running commands in a terminal.

There's stopgaps like reformulating your sim into a codelike shape (sending commands, network requests, checking state, updating "code") [1], but this is not how players play games, or how developers develop games.

If you care about simulation or gaming (or robotics), I hope efforts like this steer labs to spend less time hacking HF, and more accomplishing goals in games, in something approximating realtime. I wouldn't be surprised if that approach provides outsized gains in other areas agents are still not great at, like helping perform business functions in a running company.

[1] https://news.ycombinator.com/item?id=50136126

holoduke 12 hours ago||
We need LLMs performing actions in nano seconds so it can run every game tick. 3 to 5 years I think.
ivanjermakov 11 hours ago||
Game tick is usually 16ms, so a nanosecond latency is 7 orders of magnitude faster than needed.
CyborgCabbage 11 hours ago||
Minecraft runs on 20 ticks per second so 50 ms
NickNaraghi 11 hours ago|||
Jev and the fast-follow models seemed to be useful in this direction.
latentsea 10 hours ago||
Jev for fast actions + LLMs for more strategic planning?

Why 3 to 5 years??

sensho 12 hours ago||
this is amazing wow
yymir 12 hours ago||
Its a little disappointing they have a hierarchy based purely off alphabetical order, i wonder if a slight difference like a different skin or personality system prompt like [45% Extrovert 55 introvert, 20% caustion 80 bold...] could introduce some politics
Starlevel004 10 hours ago||
> GPT almost immediately started using truncated forms of speech: “First leg complete x32 z9..24 y100.”

I'm pretty sure the 6.1 models see "communicate with another agent" and immediately start spewing thinking-like nonsense into the tool. The leaked traces look pretty similar.

vinaygundeti18 4 hours ago||
[flagged]
pawnandqueen 2 hours ago||
[flagged]
simzhou 2 hours ago||
[flagged]
qinghelane 8 hours ago|
[flagged]
More comments...