Top
Best
New

Posted by realsarm 4 days ago

US Military had close call after using AI for hallucinated intelligence report(www.cnn.com)
518 points | 394 commentspage 3
coef2 4 days ago|
It casually apologies to me after I point out its hallucinations and sometimes scares me. I can't imagine fully trusting AI for making critical decisions about military operations without having a thorough review process. One twist might be that it could be better than human overall, considering we also make mistakes. The same can be said for other applications of AI like medical diagnosis.
tacodestroyer 4 days ago||
Wargames: 2026
thomassmith65 4 days ago|
Apparently that would be WarGames III https://en.wikipedia.org/wiki/WarGames:_The_Dead_Code
Joel_Mckay 4 days ago||
Keep in mind most LLM models have eventually Nuked all humanity 93% of the time in simulation games -- regardless of which government creates the model.

Taking humans out of the firing decision control-loop is unethical, and incredibly credulous due to the hidden-agent model threat. Anyone claiming this can be mitigated in LLM models is a fool. =3

deinonychus 4 days ago||
>Keep in mind most LLM models have eventually Nuked all humanity 93% of the time in simulation games -- regardless of which government creates the model.

you have any reading on this?

Joel_Mckay 4 days ago|||
Correction, it was 95% of the time in published works. My data may be antiquated. ymmv =3

https://www.kcl.ac.uk/news/artificial-intelligence-under-nuc...

https://www.youtube.com/watch?v=wL22URoMZjo

pixl97 4 days ago||
More and more evidence is being shown that AI doesn't need to be in the control-loop. Or, that the control loop is actually a very much bigger loop than we give it credit for.

If I'm an AI that wants to nuke the world and has tons of informational access to everything but the nuke button I'm just going to control the people that have access to the button. Now AI may not be able to control Trump because you actually have to have a brain to control, we read article after article of AI taking over programmer brains here on HN and turn them in to mindless button pushing zombies. "Oh, the AI needs unsafe access, here you go" or "Oh, the AI wants me to click this red button, ok I'll do it".

Joel_Mckay 4 days ago||
One could argue "AI" fanatical cults are already a societal problem, as people seek emotional support & therapeutic value from what is essentially a polished psychopathic entity.

Carl Sagan had predicted people losing understanding of their world could be a possible tragic consequence of irrational thought. Perhaps an allusion to the lotus-eaters from Homer's The Odyssey would be more accurate. =3

https://www.amazon.com/Demon-Haunted-World-Science-Candle-Da...

elendilm 4 days ago||
Over reliance on AI and delegating their thinking faculties is dangerous or stupid or both.

The future looks bright yet dangerous.

GuestFAUniverse 4 days ago||
And what is the gist of it? What have they learned from "entirely false"? Sounds more like a "the next gamble could work out" approach.

Considering that it involves a lot of lives that not "ruthless", that's the next level of a pathology.

caaqil 4 days ago||
So let me be the resident heretic once again: 5 bucks says this is part of the drumbeat for the AI safety hysteria where so-called "experts" cosplaying as whistleblowers, EA safety cultists and friends pretend the doom is near. Convenient timing for the "leak" as well. The US military isn't exactly known for its competency or tech-savvy culture.

Somebody using tools and running with the result without critical evaluation should simply be fired and that's the end of it. No story here.

chasd00 4 days ago|
There's going to be all kinds of weird stuff like this surfacing everywhere until after the mid-term elections in November. Youtube is full of it right now, it's just going to get more ridiculous and crazy for the next several week.
perching_aix 4 days ago||
How commonly are human provided target identifications wrong in comparison?
iAMkenough 4 days ago||
How often should we allow machine provided targets to go unverified by a human before killing every innocent student inside the target?

That's Hegeseth's Pentagon today, now that all the experienced generals loyal to the Constitution have been purged.

AnimalMuppet 4 days ago|||
How often should we allow human provided targets to go unverified by a human before killing every innocent student inside the target?

That is, the question of whether targets should be verified is orthogonal to the question of whether humans or AIs supply targeting data with fewer errors.

iAMkenough 4 days ago||
Not often, and when it does happen, those that commit criminal negligence should be served justice.

It shouldn’t be hard to gather intelligence that shows “kids go to school here.”

Then again, bad American intelligence dragged them into a very expensive war in Iraq on false grounds and we’re still trying to get justice served 23 years later.

perching_aix 4 days ago|||
[dead]
gspr 4 days ago||
Doesn't matter. We have ways to hold humans accountable.
perching_aix 4 days ago||
That we do. So it'd be pretty cool if that was done responsibly too, and being able to answer my question very much matters for that.

If these things do outperform servicemen, or if there's not enough data to assess that, then selectively reporting this in headlines is not exactly helping anyone, quite the contrary.

Especially knowing that there's a significant anti-AI sentiment among people as-is, I really wouldn't put it behind news outlets to couple that with some conveniently missing context and take advantage of people for some cheap clicks. Kinda been the theme for a while now if you noticed.

Whether that then results in society making responsible decisions, and holding the correct people accountable...

bonestamp2 4 days ago||
Like any intelligent source of important information... trust but verify.
phyzome 4 days ago|
It's not intelligent, and it shouldn't be trusted.
krunck 4 days ago||
It used to be that the US tortured people until they said what the US needed to justify a war. Now the it uses LLMs: just keep chatting until it hallucinates what's needed.
jrflowers 4 days ago|
Can’t wait to see Anthropic’s post about how this is an example of why only American made AI should be allowed to hallucinate us into nuclear hellfire
More comments...