2 ms·
I believe efforts of this nature will fall afoul of a very similar effect to the Bullshit Asymmetry Principle[0]: the amount of effort required to detect AI-wri
by danaris 3y ago
I believe efforts of this nature will fall afoul of a very similar effect to the Bullshit Asymmetry Principle[0]: the amount of effort required to detect AI-written content is (at least) an order of magnitude greater than that required to generate them in the first place. And as LLMs get further fine-tuned to generate more and more human-like text, it will get even harder. Even now, I wouldn't give an "AI Text Detector", even one built with all of Google's resources, more than about a 60% chance of correctly telling AI-generated text from human-generated.
The big problem is false positives—human-written text that gets incorrectly flagged as being written by AI. There's going to be so many false positives in any scheme like this, it'll barely be worth it.
[0] https://en.wikipedia.org/wiki/Brandolini%27s_law https://en.wikipedia.org/wiki/Brandolini%27s_law
- AceJohnny2 3y agoRelated: "it is easier to automate bad behavior than it is to police it"