Posted by hazebooth 7 hours ago
Its not creating bioweapons, but has code obfuscation that makes it look to an LLM like it is, to resist LLM reverse engineering of its code by triggering refusals. It even has Tienanmen square references to trip over the chinese models.
Sure, We will stop our LLM from decoding obfuscated code by… forcing it to “think” about suicide, self-mutilation, and killing people. This is just philosophically unsettling to me.
I don’t know what software industry I wanted to live in. But it’s certainly not this one.
"Model welfare" seems like an objectively absurd concept given the inherent training process needed to produce a usable instructions tuned model.
You guys are so cool. I'm, like, missing out by not collaborating with you all :(
Edit: who tf upvoted me? Let me keep my downvotes.