4 ms·
> Force all companies training LLMs to add some method of watermarking with a mean error rate below a set value. How do you watermark plain text?
by xienze 2y ago
> Force all companies training LLMs to add some method of watermarking with a mean error rate below a set value.
How do you watermark plain text?
- exe34 2y ago"I seem to do fine for a stretch, but at the of the sentence I say the wrong cranberry."
- xienze 2y agoSo deliberately bork the output in such a way that users lose all confidence in the product?
- lores 2y agoYou should read the original article... OpenAI say it doesn't downgrade quality.
- exe34 2y agono, you modify the output probability so that you sample in a deterministic pseudo-probabilistic way - i.e. save the seed, and insert low SNR bias into the sampling. you can recover the bias afterwards and prove you generated the sequence. my example was just a reference to Jarvis in the avengers.
- slfnflctd 2y agoThis is a fairly obvious initial question which I assume nearly everyone who doesn't already have a rough answer in mind would ask, so I'm happy to report that it's fortunately quite clearly addressed in TFA, and in fact makes up a significant part of the (not very long) piece.
- deleted 2y ago[deleted]