4 ms·
> What exactly makes anyone think that they can detect an LLM that is outputting text? Watermarking. On each word of the output, you randomly split all possib
by golergka 3y ago
> What exactly makes anyone think that they can detect an LLM that is outputting text?
Watermarking.
On each word of the output, you randomly split all possible words into two groups and only generate output using one of them. If you get a text of 1000 words that exactly follow the secret sequence of the groups, you can be sure that it's generated by this LLM with one in 2^1000 chance of error.
- dragonwriter 3y ago> Watermarking. Watermarking only works if every LLM system available does it and it is impractical for third parties to spin up and use systems that don’t, otherwise it only detects content that opts in to being detected.
- Der_Einzige 3y agoThis technique is trivially fooled by anything which messes with the Logits, which is what everyone is now doing in the non chatGPT world.