4 ms·
> Watermarks are trivially removed by the motivated and unpleasant I heard some chatter from OpenAI folks some 1-2 years ago that the way they'd watermark text
by sva_ 2y ago
> Watermarks are trivially removed by the motivated and unpleasant
I heard some chatter from OpenAI folks some 1-2 years ago that the way they'd watermark text is that rather than just using random numbers in the top-k/p sampling process, you have a pseudorandom sequence of numbers that either follows a pattern or you save them directly. This way you could fairly trivially build a tool that determines with very high accuracy whether or not a sequence of words has been generated by your model.
I think such a watermark can't be trivially removed unless you rewrite the text, or at least large portions of it.