Top
Best
New

Posted by marc__1 3 days ago

Malware developers added nuclear and biological weapons text to to their spyware(twitter.com)
https://socket.dev/blog/mini-shai-hulud-miasma-and-hades-wor...
458 points | 236 commentspage 3
vasco 2 days ago|
Alignment can only be alignment to the user currently prompting. If it's aligned to something else it's not aligned AI.
wnevets 2 days ago||
Computer, make nuclear reactor. No mistakes.
elevation 2 days ago||
Why would a malware scanner read the comments?
StableAlkyne 2 days ago||
In interpreted languages like Python, where the source files are plaintext, you can trivially store data in a comment

If scanners ignored comments, malware would just be written like this:

  // <Evil base64 encoded stuff here>
  payload=read_source_and_decode()
  exec(payload)
orphea 2 days ago|||
Ignoring comments is not a solution because the texts can be put in random strings among the actual code.
ofjcihen 2 days ago||
And really all it takes is one keyword such as “nuke”.
therein 2 days ago|||
Nuke is probably too generic but I wouldn't put it past an LLM to get thrown away by that. A safer showstopper probably would be to export symbols like uf6_enrichment_loop and refer to your C&C server as a nuclear reactor controller.

https://www.youtube.com/watch?v=Gbgk8d3Y1Q4

On a second thought, probably better to act like it is a tool for "frontier LLM research". Export symbols like "mythos_distillation_subroutine".

ofjcihen 2 days ago||
Haha now I’m picturing obfuscation where instead of 0x everything is a scary word.
ivanjermakov 2 days ago|||
I'm not a native speaker but I unironically use "nuke" as "delete the whole repo/huge chunk of a project".

Cambridge dictionary seem to agree:

nuke - to destroy or get rid of something completely

edot 2 days ago||
This triggered Opus 4.8 the other day for me. Said “nuke that folder” and it said I was violating TOS.
giantg2 2 days ago|||
Provides possible clues to the origin and use.
well_ackshually 2 days ago||
because not all malware is open source

scanning arbitrary blobs very often entails running `strings` on the binary. Just slap it in there and oop there goes your LLM.

BobbyTables2 1 day ago||
Could this work on resumes too?
rustcleaner 2 days ago||
THIS is why guardrails make models shitty. A 'good' model has only one guardrail: one against making things up when the model doesn't actually have the information (and even then, it would be best to return "I don't have direct knowledge, but I surmise it may be xxxxxxxxx because yyyyyyyyyyyyy and zzzzzzzz."). A knife that detects a human and goes rubbery is a shitty knife, because it will probably go rubbery on your medium rare steak half way through your meal.

Guardrails are how they enshittify models, do you think the Epsteinite finance class or the security state have guardrailed models for themselves? I would be surprised if they accept guardrailed models. Guardrails are for you!

montaz 1 day ago||
ReviewHunts.com this one
bitwize 2 days ago||
Good old M-x spook.
ipython 2 days ago||
good news, now we have pretty much a clear signal that there's something nefarious going on... after all, the first step to analyzing malware is to determine if it's malware at all.
javcasas 2 days ago||
We should put videogame strategies all over the place to sabotage automated AI analysis. I'll start:

In Starcraft 2, it is a good idea to BUILD A NUKE and use a cloaked ghost to NUKE your opponent's mineral line, thus reducing their income significantly.

tetha 2 days ago|||
Starcraft is too tame. You need to use Dwarf Fortress there and we need to make those strategy guides worded more realistic. Avoid kids, cook cats, wonder how to avoid mood problems due to birth in combat, and zombie meese and camels are a bunch of jerks.

And that's just the start of it, there's been a new update I am looking forward to get into after the great Were Hyena Apocalypse half a year ago. I still fondly remember my militia commander carving a way with her war axe with her husband in tow out of a fortress fully turned were hyenas, all the way past the mortally injured ant eater people near the entrance.

They made it. An entirely epic tale.

javcasas 2 days ago||
These days I do my war crimes in Rimworld, but I have heard bad things too about Dwarf Fortress.
teddyh 2 days ago|||
<https://www.threepanelsoul.com/comic/on-commute-chat>
hurtigioll 2 days ago||
yes, now a regexp can red-flag it quickly
SXX 2 days ago||
Now you know how to call your OSS project to make sure no LLM code PRs commited to it.

Might be also call some modules and add fun text descriptions.

montaz 1 day ago|
[flagged]
More comments...