Top
Best
New

Posted by ymir_e 13 hours ago

SQLite Critical CVEs or LLM Slop?(research.jfrog.com)
695 points | 347 commentspage 5
nirbendavid 8 hours ago|
[flagged]
BedVibe_Studios 13 hours ago||
[flagged]
boundsconf 10 hours ago||
[flagged]
leviyi 11 hours ago||
[flagged]
mlvljr 13 hours ago||
Honest take, this is a critical CVE.
inigyou 10 hours ago||
And for such a load-bearing infrastructure component, fixing this is not just imperative, it's urgent.
projektfu 9 hours ago||
Scout's honor!
awkwardpotato 12 hours ago||
How so? All 6 of the CVEs covered in the article did not actually exist when investigated
mahogany 12 hours ago|||
The comment is making fun of a Claude-ism where it becomes super “honest” about stuff.

It’s a joke but there is an underlying real effect where this type of language is psychologically manipulative and I would guess makes people believe LLMs output more than if it didn’t use “honest” (or “load bearing” or whatever super serious important sounding word).

ptx 11 hours ago||
Or maybe they didn't train it that way to be manipulative (although it's certainly a plausible explanation) but simply as an accidental artifact of trying to make it give honest answers?

LLM-generated images sometimes includes text from the prompt as literal text in the image, so perhaps this is the same sort of artifact? If they've told it to be honest, it responds by talking about being honest instead of actually being honest, because it has no actual understanding of anything.

inigyou 10 hours ago|||
The whole RLHF process is structured to train models to be manipulative, no matter what you thought you were training them for.
jimktrains2 10 hours ago|||
> accidental artifact of trying to make it give honest answers?

If it's not giving honest answers that implies it's purposely being deceitful, which it isn't capable of. Right?

mlvljr 12 hours ago|||
You're absolutely right, I have hallucinated this. Would you like to find some real CVEs next?
Bitu79 7 hours ago||
[dead]
effnorwood 12 hours ago||
[dead]
securitycipher 7 hours ago||
[dead]
mpfh 6 hours ago||
[dead]
bilater 8 hours ago|
This isn't great but a negative side effect of an otherwise positive change. I know a lot of comments will try to make this into a gotcha but its really not. Decreased friction leads to misuse. Just like before we'll figure out ways (reputation, light filter pass) to deal with it.