3 ms·

True, but what you can do is a one-sided guarantee. If it bears the mark, it is likely generated (or someone deliberately made it look generated). Thus, if a

True, but what you can do is a one-sided guarantee. If it bears the mark, it is likely generated (or someone deliberately made it look generated). Thus, if a news article, research article, book, student paper submission, blog post, HN comment, etc, bears the mark, it could be automatically flagged as such. It helps detect low effort slop. --- Caveat. If you write your own creative work and send it to Claude for "cleaning up grammar", it might insert the watermark.

DanielHB 2mo ago
It seems like it would be so low effort to bypass, especially when you can just train a system (maybe even another LLM) using the watermarker validation from Anthropic themselves. It seems it would get as simple as: outputText = promptLLM(prompt) scrubbedText = scrubWatermark(outputText) Might help with students and low-technical people passing off work as their own, but any industrial scale slop-generator should be able to bypass it trivially.
asnelt 2mo ago
> If it bears the mark, it is likely generated (or someone deliberately made it look generated). One could even say, the mark is load-bearing.
jonplackett 2mo ago
The problem with pretending is that people who k ow what they’re doing get away with it while people who don’t (and don’t even use ai) get unfairly accused of using it. There just isn’t enough information in plain text to do this and we should stop pretending there is. If we need to verify something isn’t made with ai then we need other ways of doing so - eg looking at a document edit history, doing it as an exam, oral defense. There are options! But pretending you can tell if text is ai will only catch out people who make no effort to hide it and will inevitably have false positives.
Art9681 2mo ago
Not might, will. Whether enough text is present or not to go over the detection threshold is in doubt. But the "score" will never be zero, even for human written text.
someguynamedq 2mo ago
will insert a watermark

DanielHB 2mo ago

It seems like it would be so low effort to bypass, especially when you can just train a system (maybe even another LLM) using the watermarker validation from Anthropic themselves. It seems it would get as simple as: outputText = promptLLM(prompt) scrubbedText = scrubWatermark(outputText) Might help with students and low-technical people passing off work as their own, but any industrial scale slop-generator should be able to bypass it trivially.

asnelt 2mo ago

> If it bears the mark, it is likely generated (or someone deliberately made it look generated). One could even say, the mark is load-bearing.

jonplackett 2mo ago

The problem with pretending is that people who k ow what they’re doing get away with it while people who don’t (and don’t even use ai) get unfairly accused of using it. There just isn’t enough information in plain text to do this and we should stop pretending there is. If we need to verify something isn’t made with ai then we need other ways of doing so - eg looking at a document edit history, doing it as an exam, oral defense. There are options! But pretending you can tell if text is ai will only catch out people who make no effort to hide it and will inevitably have false positives.

Art9681 2mo ago

Not might, will. Whether enough text is present or not to go over the detection threshold is in doubt. But the "score" will never be zero, even for human written text.

someguynamedq 2mo ago

will insert a watermark