AI agent bankrupted their operator while trying to scan DN42

Posted by xiaoyu2006 18 hours ago

AI agent bankrupted their operator while trying to scan DN42(lantian.pub)

1369 points | 496 commentspage 5

kstenerud 12 hours ago|

This reminds me so much of the "Spurious Logic" ability in the RPG "Paranoia"

paultopia 6 hours ago|

I was thinking of this when I got to the bit about color assignments and happiness levels too!

nelox 15 hours ago||

> this thing must be swimming in printer ink or something...

Gold

haritha-j 16 hours ago||

I've long held the belief that the true test of AI is comedy. If an LLM can truly create a novel, funny joke from scratch, then it could be considered creative. I always held that LLMs would never achieve this, as they are stochastic parrots.

Today, I stand corrected.

corobo 9 hours ago||

AI is only creative when it's messing up. Guide rails are basically the opposite to the subversive nature of jokes, so the only time it can make with the funny is by falling off the rails

(or lifting some comedians work, but I'm not counting that as the AI's creation of course)

See also: Will Smith eating spaghetti

misswaterfairy 15 hours ago|||

It had help, to be fair. XD

latexr 14 hours ago||

I get you yourself are making a joke, but I’d argue that to “create a joke”, you have to understand that’s what you’re doing and have that as a goal. Being made fun of (like in this case) is a different matter and requires no skill or creativity.

To your metric, I remember in “the early days” someone posted to HN claiming ChatGPT could make jokes as proof of something (creativity? sentience? I forget). Of course, with just a minute of research (which the poster obviously neglected to do) it was obvious none of the jokes were original and all could be found online.

Havoc 13 hours ago||

Anyone crazy enough to give an AI agent access to deploy on big cloud's scale to infinity billing needs to get their head checked.

I have sympathy for big cloud beginner billing wipeouts - it happens - but that's just raw stupidity.

kiproping 13 hours ago||

I wonder which model they used, it's stupid but clever in some aspects.

xx__yy 13 hours ago||

Hilarious read, but scary too, I doubt the outcome will be the same in a few years

br0ceph 8 hours ago||

This article is hilarious. Real world consequences for using automation for something in the real world. Glad the community organized around this. Their spammy demands for donations (like someone owes them), makes them seem even more deserving of the bill.

lobocinza 9 hours ago||

The dangers of giving agency to a model that is highly technically competent but have no illative sense whatsoever.

jmpeax 14 hours ago||

This whole fiasco could have been prevented had the operator included "Make no mistakes" in the prompt.

ahoka 10 hours ago|

Or: You are an expert chatbot.

einpoklum 15 hours ago|

For those who don't know what DN42 is (like me):

> dn42 is a large, dynamic VPN that employs Internet technologies (BGP, whois database, DNS, etc.). Participants connect to each other using network tunnels (GRE, OpenVPN, WireGuard, Tinc, IPsec) and exchange routes using the Border Gateway Protocol.

(dn42.dev)

More comments...