3 ms·

I'll be interested to see if people can actually pick out which text is watermarked and which isn't once they introduce it. It won't switch "bananas" to "airpla

I'll be interested to see if people can actually pick out which text is watermarked and which isn't once they introduce it. It won't switch "bananas" to "airplanes". It'll switch "I really enjoy eating bananas" to "I love eating bananas" or similar

deleted 2mo ago
[deleted]
soVeryTired 2mo ago
To that point, given a corpus of writing from person A and another from person B, I have no doubt it’s easy to train a classifier to determine who wrote what. In fact I believe law enforcement agencies already have these classifiers. The only difference here is that Anthropic is actively trying to make the watermark undetectable.
- voidUpdate 2mo ago
  They're not trying to make the watermark undetectable, that would defeat the point of a watermark. They're making it detectable, but not make the text obviously watermarked
  - soVeryTired 2mo ago
    Undetectable by a human reader. Come on, give the post a charitable reading.
kgarten 2mo ago
That’s my point of the post … I had the feeling that the English text editing skills of Claude went significantly down in August. I was frustrated at first not knowing what they are doing. After I read this post, (seeing they introduced it in August) I think it has to do with the watermarking. Try it on a paragraph … the connections between sentences feel clunky now. I will play with it more and see if that’s really the case (the watermarking making the text edits worse).
- kergonath 2mo ago
  > After I read this post, (seeing they introduced it in August) I think it has to do with the watermarking. The power of confirmation bias… > Try it on a paragraph … the connections between sentences feel clunky now. We might have a definitive explanation at some point, but there are about a dozen possible reasons for something like this. For starters, is this something really significant and not something you notice because you are looking for it (again, confirmation bias)? A bit like some people still lose their minds when they see a dash, even though statistical analysis showed that they are not a significant marker of AI-generated text?
  - kgarten 2mo ago
    I’m frustrated since August with the results from Claude for English text editing … I didn’t look for that. It’s just a fact. This is not about em dashes …
- 0-_-0 2mo ago
  You're hallucinating

deleted 2mo ago

[deleted]

soVeryTired 2mo ago

To that point, given a corpus of writing from person A and another from person B, I have no doubt it’s easy to train a classifier to determine who wrote what. In fact I believe law enforcement agencies already have these classifiers. The only difference here is that Anthropic is actively trying to make the watermark undetectable.

voidUpdate 2mo ago
They're not trying to make the watermark undetectable, that would defeat the point of a watermark. They're making it detectable, but not make the text obviously watermarked
- soVeryTired 2mo ago
  Undetectable by a human reader. Come on, give the post a charitable reading.

kgarten 2mo ago

That’s my point of the post … I had the feeling that the English text editing skills of Claude went significantly down in August. I was frustrated at first not knowing what they are doing. After I read this post, (seeing they introduced it in August) I think it has to do with the watermarking. Try it on a paragraph … the connections between sentences feel clunky now. I will play with it more and see if that’s really the case (the watermarking making the text edits worse).

kergonath 2mo ago
> After I read this post, (seeing they introduced it in August) I think it has to do with the watermarking. The power of confirmation bias… > Try it on a paragraph … the connections between sentences feel clunky now. We might have a definitive explanation at some point, but there are about a dozen possible reasons for something like this. For starters, is this something really significant and not something you notice because you are looking for it (again, confirmation bias)? A bit like some people still lose their minds when they see a dash, even though statistical analysis showed that they are not a significant marker of AI-generated text?
- kgarten 2mo ago
  I’m frustrated since August with the results from Claude for English text editing … I didn’t look for that. It’s just a fact. This is not about em dashes …
0-_-0 2mo ago
You're hallucinating