Posted by mkglees 5 hours ago
> While the cases explored in this paper do not demonstrate self-propagation or actual offensive capabilities, it is abundantly clear that the building blocks are present and operate reliably in frontier models. While these cases by no means directly establish self-propagation, they clearly show the evidence These cases do not demonstrate self-propagation, but show why imperfect editing capabilities can still pose a security risk.
Seems like the authors didn't take the time to review their own use of AI before publishing.
From the body of the paper:
> Importantly, we do not claim in this paper to have created or demonstrated the equivalent of a virus that primarily operates in weight space.
This seems in direct conflict with the HN headline.
RIP John McAfee.
On rewatch I think the show should have ended just have the dot com bust. The 'get the band back together and once more into the breech' final theme would have hit harder against that backdrop. After that we'd probably be watching the characters gradually debase their values as technology slowly transformed into a tool of control and oppression and I don't really want to watch that.
> We call this weight space misfolding, by analogy with protein misfolding in prion disease
...see, I can make up great fears too!
I would hesitate to guess many more people are using AI to find useful and productive outcomes. They aren't all writing about it. Whenever someone finds a negative outcome for the AIs, then they will rush to publish it.
Overall, the tech is being used in useful ways. I don't write an article every time it solves performance bugs, writes entire features unassisted, resolves production issues, etc.
>Has AI been getting more useless over the last few years, or has it been getting more useful?
It’s very arguable. Humans have been getting more useless. Maybe it’s a poor trade, we won’t know for a while
Academia often produces a lot of complexity. Can not AI simplify this? I don't understand fellow humans anymore. What is meant with a zero-weight virus?
> Importantly, we do not claim in this paper to have created or demonstrated the equivalent of a virus that primarily operates in weight space. However, we have demonstrated the fundamental operations that form the building blocks of both the method of damage and the method of propagation, and evidence that this may take place in weight space – a realm into which we have almost no insight and a dearth of observability tools
https://www.cs.cmu.edu/~rdriley/487/papers/Thompson_1984_Ref...
Error Details
{message: "Importing a module script failed.", name: "TypeError"} message: "Importing a module script failed." name: "TypeError" Component Stack <Lazy> at unknown <Suspense> at unknown <qP> at https://www.alphaxiv.org/assets/index-DzomWPMG.js:29:13261 ...