2 ms·
There also seems to be some willingness to have the models watermark their content, and LLMs provide very subtle methods to do so. For example for sufficiently
by wongarsu 3y ago
There also seems to be some willingness to have the models watermark their content, and LLMs provide very subtle methods to do so. For example for sufficiently long texts you could bias the token selection to achieve a very specific frequency for certain words; and declare any text where the word "the" makes up between 5.1% and 5.7% of all words, and "which" about 1% of all words to likely be generated by that AI.
One major issue is the feedback loop: There is lots of entrophy to hide a signal in regular English (whether you follow the methods of Stylometry or Steganography), and even an unmodified AI model has a stylometric signature. But if a significant portion of text we consume ends up being written by a handful of AI models, over time people will adopt many of these features. This is obvious right now, with ChatGPT having a certain writing style and some people unconsciously copying that style, and it will remain true no matter how subtle these things become.