3 ms·
It seems to me that a model provider who can watermark generated text (unbeknownst to the users) could also specifically watermark generated text prompted by pa
by treetalker 2mo ago
It seems to me that a model provider who can watermark generated text (unbeknownst to the users) could also specifically watermark generated text prompted by particular users, thus enabling tracking and, consequently, harassment and control of those users and populations as a whole. Bad for anonymity and for free speech.
I hope to be corrected by someone who knows the tech much better than I do.
- arlcode 2mo agoThat is a concerning possibility but I wonder what the threat model is. They have all that information already and could simply classify and pass it on without the need to encode it with a probability.
- xscott 2mo agoOne possibility is that you have Claude write something that would not get you in trouble and concatenate that with something you wrote by hand that would. Your signature from the safe material is now associated with your content on the dangerous part, and then the brownshirts come knocking on your door.