Top
Best
New

Posted by ropbear 18 hours ago

Anthropic's 'watermark' text adulteration in Claude is a perversion of writing(daringfireball.net)
567 points | 497 commentspage 5
tempestn 7 hours ago|
LLM output, as the author acknowledges here, is already non-deterministic. Next token probabilities are set, and tokens are chosen pseudo-randomly. As I understand it, this watermark is just going to be a matter of using a known seed and algorithm to make those pseudo-random choices, such that a signature can be detected. The important thing is, it's not replacing intentional choices with random ones, it's just generating pseudo-random results differently. Quality shouldn't be affected.
simonh 7 hours ago|
That cannot be true. The quality of an LLM's output is the quality of the probability calculations for the next token. Anything that degrades the relationship between the system's best assessment of the appropriate probability and the actual probability used is a degradation of the quality of that probability and therefore of the output.

If this didn't have a detectable effect on the quality of the token probability calculation, the watermark wouldn't be detectable. It may be a small degradation in the quality of the output relative to the neds of many users in many situations, but it's not zero. It's literally sometimes choosing different words that it otherwise would specifically for watermarking purposes.

phiresky 7 hours ago|||
An encrypted hard drive is EXACTLY uniformly distributed random bytes if you do not know the encryption key. No one would be able to tell the difference between a drive that is just purely random numbers or is actually filled with content. (Of course excluding the usually intentionally added readable header)

If this was not the case, the encryption would be broken, and most everyone agrees that good encryption does exist.

The "quality of the probability calculations" as you put it is 100% in this case and any less would be a huge deal (as in - breaks all of the internet).

So, now you just take those same random bytes and use them as the seed for your LLM token choices. The output has the _cryptographically_ proven exact same quality as if you were using a true RNG (which you likely weren't using anyways).

You just need to know your LLM distribution and the encryption key, then with each new token you exponentially increase the chance of knowing whether it fits your encryption key. Without actually affecting the token choice in a perceivable manner.

> choosing different words that it otherwise would

The "that is otherwise would" is carrying all the weight here. "Otherwise" is sampling from a distribution. You just sample from the same distribution but with a cryptographically secure, seeded RNG. https://en.wikipedia.org/wiki/Cryptographically_secure_pseud...

"Knowing the LLM distribution" seems to me like the only hard part because you don't know the context of any random snippet.

simonh 5 hours ago||
>You just need to know your LLM distribution and the encryption key, then with each new token you exponentially increase the chance of knowing whether it fits your encryption key. Without actually affecting the token choice in a perceivable manner.

I struggle to understand the relevance of that comment.

The blue/green token list biasing process literally does cause different tokens to be occasionally chosen. Not only that, but because a different token was chosen at one point, this changes the probabilities of all subsequent tokens, and the resulting later token stream every time it happens. If you had access to the token stream as it would have been, and the watermarked one by the end of the text they will be very noticeably different.

nomel 18 hours ago||
> The provider must mandate in their terms-of-service that users not remove the watermarking.

So, you don't own the generated text, and can't use it freely then. What if I copy paste a section, or rewrite a section of text to my liking? What if I rewrite some lines of code that contains the mark?

Security theater, and vague enough to be used as a weapon against who the government wishes.

I hope it's left off for non-EU customers.

inigyou 16 hours ago|
You know you can just ignore EU laws outside of the EU
knollimar 7 hours ago||
They are literally asking for Anthropic to do that rather than roll out 1 system for everyone.
armchairhacker 8 hours ago||
Are there some narrow cases (like in outputting the input almost verbatim) where the probability for every best token is always much higher than second best, and in those cases would there be no watermark?
stabbles 18 hours ago||
Claude's writing was already easy to recognize. The fact that Anthropic complied without complaint makes me wonder if they already watermark their outputs and used the opportunity to create goodwill. Presumably they want to avoid training their new model on text generated by the previous model, so they have reasons to be able to recognize AI-generated text.
bejd 6 hours ago||
>in areas where there is an arbitrary choice between particular words or terms within the code, the watermark can be used, such as comments within code.

I wonder if this is why Opus 5 keeps writing excessively long comments, even though I keep instructing it not to (both in chat, CLAUDE.md, and in its memories)

croemer 3 hours ago|
Opus 5 does not have the watermark yet. Only models released from now on.
thinkingemote 7 hours ago||
I think we will see a hidden motivation behind this as ultimately so the output can have an author, the author can be attributed and finally the output will be copyrighted and so the LLM has more value.

Everyone who invests in AI companies wants to see the value of their investment increase.

I'd give it about 3-5 years until an AI company claims copyright over code their LLM produces. This is a crucial step in that path.

Cakez0r 7 hours ago||
I think you're right that it's actually to do with attribution (i.e. They're not just watermarking your output as claude generated, but watermarking it as claude generated _by claude user id 73684_). I think it's more to do with the growing militarization of the internet. Just another brick in the wall of enter your phone number to create an account, send your id to prove your age, smile for the flock cameras, etc. Allowing the plebs to have privacy and anonymity is not allowed anymore.
tjpnz 6 hours ago||
As someone who doesn't utilize LLMs for writing production code I'm looking forward to starting a consultancy and reaping the rewards.
andrethegiant 2 hours ago||
Great question buried at the bottom:

> Also, what happens if another major global market makes it unlawful for AI to secretly watermark generated text?

elpakal 5 minutes ago|
That is a good question

> We’re applying watermarking globally at launch because we don't yet have a durable way to scope it by region. However, we will continue to evaluate different approaches, and will share updates when we have them.

So unless they figure it out, would that 'major global market' essentially need to be the US?

walrus01 18 hours ago||
> I want any LLM I use to choose the very best, most precise words at every single decision point.

Try running an llm like qwen 3.8 27B in Q8 locally with an intentionally very low temperature setting, it will write like a caveman crossed with a robot. You may find that an extremely literal output does not look pleasant to read for humans.

LoganDark 17 hours ago|
That is not what that means. Generally, precise word choice requires more than autocomplete. Larger models simulate this with hidden layers.
walrus01 17 hours ago||
Excessively precise word choice does not result in something that looks like content written by, or palatable to humans. It looks like you gave a high school 12 grade student a science paper and told them to apply a thesaurus to at least one word in every sentence and replace it with something else.
LoganDark 17 hours ago||
There is a difference between precise word choice and concise word choice. You can be precisely accessible the same as you can be concisely terse.
fwlr 7 hours ago||
If we wish to use “the very best, most precise words at every single decision point” then I will note that “writing” is not the best word for what LLMs are doing. A more precise synonym might be “generating”, in which case this essay becomes “Watermarking is a perversion of text generation” - which is true, albeit somewhat trivial.
matheusmoreira 3 hours ago|
> It’s unacceptable for a tool to sacrifice an iota of clarity, coherence, meaning, quality, etc. for the purpose of embedding hidden clues within the text to suggest its provenance.

Yeah, that about sums it up!

More comments...