Posted by Canopy9560 11 hours ago
Would single quotes solve this
Which types of documents have this particular AI vulnerability?
This is equivalent of sql injection and normal worm.
The same process happens in the perfectly "secure" case of errors in text. They propagate. People pay way too little attention to that, even though unlike security stories, this affects many if not most LLM users at this point.
This post covers a coordinated disclosure with Microsoft (MSRC) regarding a vulnerability class that allows attacker-controlled instructions in an attached document to hijack Copilot for Word.
It manipulates the AI to alter the output text (e.g., halving financial figures) and append the attack prompt into the new document concealed as white text.
Because the downstream document now carries the payload, it acts similarly to an AI worm across normal user workflows. Microsoft deployed multiple fixes over a 144-day coordination period, but the broader vulnerability class remains unmitigated and exploitable because it exploits fundamental limitations of current LLMs.
When attacker instructions are combined with legitimate information the model's context window, the tokens being inspected participate in the act of inspection, meaning current LLM architectures provide no reliable boundary between intention and interpretation.