Posted by latexr 6 hours ago
Posts later about it saying their prompt was to find useful ways to make humans money.
There's a person behind every agent. That person may choose to be careful or not, but they are ultimately responsible.
Edit: I'm being persnickety about that distinction because it matters for where the blame lies and the response demanded. If they're training rabid dogs then adding cybersecurity safeguards is a bandaid/irrelevant and we need to be focused on making sure they, you know, stop training rabid dogs. Pacing the frontier, regulation etc. they're the ones training these models it's still their fault but not in the same way
The safety problem is not solved and is likely unstoppable.
But also, frontier models are digging up tons of zero days even in "serious software". I'm sure any sandbox you and I can come up with looks like Swiss cheese to Astra 7.