3 ms·
An interesting factor of this is competition. If Claude was the only model family they could ship a change like this and users who want to cheat (or don't like
by simonw 2mo ago
An interesting factor of this is competition.
If Claude was the only model family they could ship a change like this and users who want to cheat (or don't like watermarks for other reasons) would just have to put up with it.
In a world with many different competing models, the risk of losing customers to other providers over this is much more real.
Maybe they've looked at the numbers and the portion of people who clearly use Claude to cheat on examples etc is so tiny that losing them to other providers isn't a problem?
- gajus 2mo agoThere are already small models trained specifically to prevent statistical detection, e.g., https://huggingface.co/kalpeshk2011/dipper-paraphraser-xxl https://huggingface.co/kalpeshk2011/dipper-paraphraser-xxl I guess whoever is the policy maker is assuming that some protection is better than none and that most people will not reach for such tools.
- slowin 2mo agoI’m more worried that this will degrade performance. I want the best results from a model, not the results that fit a constraint that’s not defined by me. Any increased cost or latency is also unacceptable.
- lhd1 2mo agoScott Aaronson spoke about this in a colloquium where he said that this was mooted at OpenAI before the decision was made by Altman to not implement it for the reasons you describe. https://youtu.be/9udWn1Hlj_s?si=VWOiK5-y4zcyDoHI https://youtu.be/9udWn1Hlj_s?si=VWOiK5-y4zcyDoHI
- reasonableklout 2mo agoOpenAI will soon be adding watermarking to text as well, as it signed the EU Code of Practice on Transparency of AI-Generated Content: https://openai.com/index/advancing-responsible-ai-across-europe/#:~:text=we%20are%20working%20to%20expand%20provenance%20measures%20for%20OpenAI%E2%80%99s%20systems%20across%20modalities%2C%20including%20text https://openai.com/index/advancing-responsible-ai-across-eur...
- nprateem 2mo agoEither that or they want to comply with the EU AI Act when it affects them.
- andai 2mo agoPresumably the expected cost of doing it is less than the cost of getting fined by the EU for not doing it.