3 ms·
Could do with some context on how watermarking works. Objectively speaking it should be impossible to tell.
by NotPractical 1mo ago
Could do with some context on how watermarking works. Objectively speaking it should be impossible to tell.
- marcyb5st 1mo agoMy understanding is that watermarking in prose is basically a bias when sampling tokens. For a system that knows the average probability for each possible token in the LLM vocabulary it is possbile to quantify said bias given enough text. For a human that doesn't reason in tokens and therefore doesn't know anything about their probability distribution, it should be impossible to tell. Relying on fancy words/constructs within sentences should not give you any signal as well, since you don't know if the the prompt included instructions for that.