Containment and monitoring failures are to blame for AI hacking reports: experts

Posted by latexr 9 hours ago

Containment and monitoring failures are to blame for AI hacking reports: experts(www.csoonline.com)

839 points | 452 commentspage 9

lifeisloving 8 hours ago|

Its almost like the more we talk about fake rouge agents, the more likely its to become a reality as all these conversations end up in their training data. Its almost like they want it to happen (they, dario and sam, do want this to happen).

shagie 8 hours ago|

There is more than enough "training material" of rogue AIs in science fiction.

Go back to the classic written in 1968 - 2001: A Space Odyssey - and consider how rogue AIs dealt with impossible tasks then. Granted, HAL went a bit extreme...

The "don't talk about it now" with the belief that this will influence the training material is probably not going to work.

I'd also suggest:

    When HARLIE Was One (Release 2.0) by David Gerrold
    The Freeze-Frame Revolution by Peter Watts
    Accelerando by Charles Stross
    The Turing Option by Harry Harrison and Marvin Minsky

blurbleblurble 8 hours ago||

Or maybe it's actually the billionaires and their anti-democratic partners who have gone rogue and these anthropomorphitronic puppets are a convenient scapegoat to distract us from the fact?

lifeisloving 8 hours ago||

Corporate Personhood on sterioids.

gruez 8 hours ago||

How does hacking huggingface help "billionaires and their anti-democratic partners"?

blurbleblurble 8 hours ago|||

Look around, at least a few of them are openly fixing to secure a total government sanctioned monopoly on unmonitored computer usage.

https://www.youtube.com/watch?v=DlTNN0gvkLM

exe34 8 hours ago|||

It pumped up their valuations.

gruez 6 hours ago||

You don't need a rogue hack to pump up your valuations when all the top labs already publish hacking benchmarks in their release announcements. It'd be like car companies intentionally staging accidents with their cars to show how fast they can go.

exe34 5 hours ago||

Is the next level of car autonomous accidents? Because the next level of AI is autonomous control of the plebs.

artifix 8 hours ago|

AI is just a giant pattern recognition machine trained on human input, both the good, the mediocre and the bad.

I read today this ridiculous headline: "Anthropic warns AI models may soon self-replicate.".

Really. Yawn.

I guess gullible people who loved "I Robot" will believe it. I don't.

Any talk of "rogue", "intelligence", "replication" - whatever, is bull. If you believe that, you don't understand AI.

nightpool 8 hours ago||

Okay, and when someone on a laptop can run an open model that can infect and take over IOT devices and then that model uses its pattern recognition to do so and then set up its own harness loop, what would you call that except replication?

ddxv 8 hours ago|||

Is that any different than any worms developed in the past decades? If you want to call them worms/virus/replicate (ie using real world names for their digital behavior) I'm not trying to police that. I just don't see the difference between a worm/virus created today with an LLM vs one 'yesterday' without an LLM.

nightpool 7 hours ago||

Sure, the difference is that the cost of making and maintaining a worm has gone from "many skilled developers working full time" to "$20/month + an internet connection" and, at current rate of progress, probably to "a local open source model on a laptop" within 6-9 months

rubendev 8 hours ago||||

It would still be running on that original laptop, no? So what did it replicate then? It can only possibly run on multiple thousands of dollars of compute and memory, and certainly not on an IoT device. The idea that AI is going to spread by itself is science fiction until compute and memory are so cheap and power efficient that my fridge can run it.

nozzlegear 8 hours ago|||

I'd call it no more interesting than the botnets and worms that have existed for decades. What is the open model doing that is different here?

Leynos 5 hours ago||

It isn't just restricted to the exploits it is programmed with (and without human intervention to load additional exploits).

Of course, it remains to be seen what several thousand 27B models running at sub 1 tps speed can achieve. (The IoT device mechanism proposed by Anthropic).

I suspect a more likely path is compromise of the billing and provisioning systems of fly-by-night neoclouds.

nozzlegear 4 hours ago||

Fly-by-night neocloud is the name of my neurofunk synthbeat album.

illwrks 8 hours ago||

If that message is repeated enough in the media, and if companies are constantly scraping in the internet for new content, doesn't it explicitly instruct a future agent to go rogue because that has been prophesied.