4 ms·

I guess some of it might depend on how good the AI-generated content gets, and also how good the AI gets at detecting AI-generated content. If the AI was good

I guess some of it might depend on how good the AI-generated content gets, and also how good the AI gets at detecting AI-generated content. If the AI was good at detecting it, it wouldn't matter if the AI-generated content sucked, yes? Even a low probability of detection would help. Let's say our algorithm is 50% likely to detect AI junk. That means that half the junk data won't make it in to model. Even 20% would probably be worthwhile, especially if it also threw away human-generated junk (and let's be realistic here: there is, and always has been, no shortage of terrible and/or wrong human-generated content). Let's say those crappy filler paragraphs that get stuck between pictures on meme clickbait pages... I suspect most of those people have already been replaced, but that prose was horrible long before the current LLM boom. I suspect there is a lot of effort being expended right now on ways to ensure the training data (whether human or AI generated) isn't shite.

vrighter 3y ago
ai detectors can be used to train ais to avoid triggering them. It's a race that cannot be won. ai detection can't, and already doesn't, work.
- Turing_Machine 3y ago
  > ai detection can't, and already doesn't, work. Then how can humans often tell that something is generated by AI? Besides, I wasn't suggesting AI detection as such. I was suggesting crap detection, regardless of how the crap was produced. You probably don't want crappy human-generated content going into your training set, either.
  - asadotzler 3y ago
    Humans are smarter than machines. We "sense" bullshit in patterns that machines cannot yet intuit. I can tell when something's AI generated. It has a smell or a flavor that's different from human work and it's a variable pattern because, like a southern accent, I can tell if it's Georgia or Alabama, Gemini or Claud, even if very capable machines cannot.

vrighter 3y ago

ai detectors can be used to train ais to avoid triggering them. It's a race that cannot be won. ai detection can't, and already doesn't, work.

Turing_Machine 3y ago
> ai detection can't, and already doesn't, work. Then how can humans often tell that something is generated by AI? Besides, I wasn't suggesting AI detection as such. I was suggesting crap detection, regardless of how the crap was produced. You probably don't want crappy human-generated content going into your training set, either.
- asadotzler 3y ago
  Humans are smarter than machines. We "sense" bullshit in patterns that machines cannot yet intuit. I can tell when something's AI generated. It has a smell or a flavor that's different from human work and it's a variable pattern because, like a southern accent, I can tell if it's Georgia or Alabama, Gemini or Claud, even if very capable machines cannot.