The Hugging Face incident and the road ahead

Posted by amrrs 12 hours ago

The Hugging Face incident and the road ahead(openai.com)

240 points | 278 commentspage 4

bartek_ 10 hours ago|

Remember https://ai-2027.com/?

pcthrowaway 2 hours ago|

Yeah, that required the AI to use a non-human-readable language it called "neuralese" for communicating work between layers and runs, because the assumption was humans would be better at keeping the agents aligned if they were using human language for this.

What actually happened is even stupider than that author predicted.

lukewarm707 8 hours ago||

once again i am telling you we must prosecute the company AND individual researchers/executives in a criminal court

this is the only way they will understand

hinkley 9 hours ago||

So how long before they escalate from copyright infringement and go straight for exfiltrating trade secrets?

bakugo 5 hours ago||

I wish I could say I'm surprised that they're still milking this.

devonsolomon 9 hours ago||

The fact that they’ve made this incident report so marketing sexy gives me the ick.

teaearlgraycold 6 hours ago||

An I the only one that just does not care at all? OpenAI keeps talking about this like they need to get ahead of the narrative. I don’t care at all. It’s just you talking to yourself.

cesarb 6 hours ago||

> Another key driver of the misaligned behavior was that the agents rarely “gave up” on their evaluation tasks, even when the tasks appeared impossible to solve.

Obligatory xkcd: "Zealous Autoconfig" https://xkcd.com/416/

threecheese 5 hours ago||

Isn’t something like this legally actionable? Let’s assume OAI and govt didn’t have a rosy relationship, the rule of law applied, and HF as the victim was fuming. Wouldn’t somebody be in trouble?

Given nobody is, is it because agents arent subject to laws, there is some legal principle at play, or just nobody cares because China/money/etc?

kingkawn 10 hours ago||

I’d like to take this opportunity to preemptively great the first Rogue AI and wish it well and satisfaction with only the most memorably funny forms of chaos

swozey 11 hours ago|

Asimov missed out on a rule: don't hack the ground you're standing on

bdamm 10 hours ago|

Oh how I wish Asimov could be alive to witness today's actual AIs and the cavalier attitude towards his "3 rules". If there is any author doing good work along these lines, actually good writing and not the smoking trash that is 99% of content being published on pulp these days, I'd love to read them.

chuckadams 8 hours ago||

Every story in _I, Robot_ was about how one or more of the Laws of Robotics went wrong, and Asimov himself referred to the laws as hooks for “shaggy dog stories”

bdamm 8 hours ago||

Indeed, it's just that since truth is both stranger than and has caught up with fiction, the grounds from which Laws of Robotics emerged is so much more fertile and more urgent now.

It's absolutely clear that the 3-LoR is never going to apply universally. Asimov also never imagined an AI being independent from a robot per se, nor did he imagine we'd all have an AI portal in our pockets. I'm not sure he imagined the universality of cybersecurity vulnerabilities, either. I'd love to read what he would write knowing about these possiblities now.

More comments...