Top
Best
New

Posted by ropbear 1 day ago

Anthropic's ‘watermark’ text adulteration in Claude is a perversion of writing(daringfireball.net)
782 points | 687 commentspage 18
RegardDetector 1 day ago|
[flagged]
ghomst 1 day ago|
[flagged]
avazhi 1 day ago||
Anthropic should just pull out of the EU at this point. Europeans who really want to use it can VPN, and if they did they wouldn’t be able to hide behind their various comical tech laws.

Nanny state nonsense indeed.

As a non American/non European resident all I see from the Europeans are 0 contributions to software progress at any large scale while they surely do a lot of crying and huffing and puffing and demanding. Lots of complaining and rule making but not a lot of creating is a bad look.

breezybottom 1 day ago||
Clearly Anthropic thinks its more profitable to comply and have access to the European market, but I'm sure you know better than the people who brought it to a $2 trillion valuation.
avazhi 1 day ago||
I didn't say anything about profitability. Since Anthropic is all about the good of mankind etc, ostensibly profitability isn't their number one priority.
carlosrg 21 hours ago||
Hi Gruber.
snickerbockers 1 day ago||
What is even the point of watermarking AI slop supposed to be? All it does is provide people with the false implication that anything which is not watermarked must not be AI-generated.

I struggle to see how this could possibly be useful unless there's some sort of psy-op going on to trick people into uncritically accepting anything lacking a watermark as not being AI-generated.

nomilk 22 hours ago||
tl;dr:

> It’s unacceptable for a tool to sacrifice an iota of clarity, coherence, meaning, quality, etc. for the purpose of (watermarking)

And an example of the impact of watermarking on word choice [0]:

> The results of the study were quite [important || significant || substantial || notable]

The meaning of the sentence to changes slightly even in just this tiny example. Imagine the degradation when applied across an entire response!

[0] https://declaude.org/watermarking/

jimnotgym 22 hours ago||
I recently found there was no website covering a historical subject, with sites begging to be visited. The information was scattered and not presented in the form people would find most useful (a map).

A couple of days later it was up with the most comprehensive review of the available info summarised and referenced ready for a human researcher to explore.

This was only possible due to AI. It would have taken me weeks to chase it down and summarise it, so it would never have happened. Let's get off our high horse about AI writing.

veidr 1 day ago||
This (Anthropic's "watermark" stance, I mean) is so fundamentally ludicrous that I have assumed it is a (wholly insincere, but arguably pragmatic, at least from their perspective) attempt to deal with the EU and their latest misguided, ham-fisted attempt to solve a real-world problem by drenching the entire world with more regulatory slop[1].

The "watermark" can be trivially defeated, but may be enough to satisfy the letter of the law, and like many people here, I would argue that if you are letting Claude write for you, you've already accepted getting the literary equivalent of turd soup, so the harm is — or at least could be — fairly minuscule.

[1]: https://digital-strategy.ec.europa.eu/en/policies/code-pract...

(FWIW I have a more favorable view than most people seem to of the EU's efforts to at least try tackle problems like this — but predictably, the bureaucratic "solutions" they come up with don't work, but do make things objectively worse)

akersten 1 day ago|
Respectfully, you are all missing the point.

Watermarking is bad not just because of the principled stance that your tool should not be working against your own interests (the passionate argument in TFA), but specifically because it lends credence to the idea that AI detection is a valid and possible thing to do perfectly.

As technologists of course we know "oh well yes but with some confidence interval we can detect AI token bias across a large corpus of text." To JimBob in charge of publishing your paper or reviewing your PhD submission, all he knows is "anthropic says AI detection is possible so this 30% chance your paper was written by AI means you've plagiarized." Do you really think you're winning the argument with the certified, law-approved plagiarism detection machine? No, you're not, and your career is over.

It's irresponsible to develop watermarking because it is not anywhere close to a perfect science, but it will be treated like one by people with the power to ruin your lives. Even if you've never touched AI in your life, your paper is going through the "maybe it says you cheated" box, and you better hope those dice don't come up snake eyes.

otterley 1 day ago||
I suspect there’s a niche market for software that records your writing process to help you avoid being falsely accused of using AI to write.
wasabi991011 1 day ago||
You should submit an article about this instead of having your point buried in a comment section of an article making an unrelated argument.