5 ms·
> That's no different from saying "since any watermark can be reversed, none of them matter, and we should just use THIS WAS WRITTEN BY CHATGPT". I’m not sure
by mattnewton 3y ago
> That's no different from saying "since any watermark can be reversed, none of them matter, and we should just use THIS WAS WRITTEN BY CHATGPT".
I’m not sure we shouldn’t do this; at least people wouldn’t put false stock in watermark detection methods. As it is now, what a watermark not being detected says is that this wasn’t copy-pasted directly from an LLM, but what lay people will understand is that “this was not produced by an LLM.” That’s a dangerous muddying of the waters in my opinion.
- wongarsu 3y agoYou can make watermarks that survive manual transcription. But then you have to get a lot more clever than replacing whitespace with different whitespace, and instead encode information in parts a human would preserve. Word choice, spelling choices, punctuation, etc. provide a lot of space to encode a signal. Basically anything used by traditional authorship detection/stylometry.
- JohnFen 3y agoA few lifetimes back, when I was in high school, I developed a text stegonography program that encoded this way. If relied entirely on minor changes to grammar that didn't make the text ungrammatical. That code is long lost, and I was a kid, so never characterized it in any meaningful way. But it was interesting and seemed to work. The downside was that you had to have a fairly lengthy text to encode anything but very short messages.
- mattnewton 3y agoI mean, if the detection method is open for people tp use they can perturb it until it isn’t detected anymore and if it isn’t open how do we know it isn’t full of false positives.