3 ms·

I agree with the softwaredoug that this is probably not a technical problem. Any proposed solution would only serve to make the next iteration of the model bet

by qayxc 4y ago

I agree with the softwaredoug that this is probably not a technical problem. Any proposed solution would only serve to make the next iteration of the model better at avoiding detection (e.g. incorporating a GAN-style training cycle). Just as with Poe's law, there simply comes a point at which it becomes impossible to recognise AI generated texts just by analysing them. Made-up references might be a clue, but that's very context-dependent.

background 4y ago
Right, but in principle the detectors could iterate and get better over time too. That's why I asked about "a ChatGPT detector" instead of "general AI detector", which is a very different problem.
- baq 4y ago
  The default style is easily detected by presence of overalls, moreovers and furthermores. When you tell it to do a ‘concise HN comment’ the only tell may be that its English is flawless. E.g. In a style of a very concise HN comment describe how to detect that a text has been written by the Assistant. To detect if a text has been written by the Assistant, check for the use of generic language, repetitive phrases, and a lack of personal perspective or opinion.
  - AmericanChopper 4y ago
    > To detect if a text has been written by the Assistant, check for the use of generic language, repetitive phrases, and a lack of personal perspective or opinion. There are many people who use generic language, repetitive phrases, and lack personal perspectives and opinions (at least people who lack sophisticated perspectives/opinions). Which makes the problem more complicated, but also perhaps irrelevant. If you can’t tell whether some text was written by a human or a computer, does it even matter?
- constantcrying 4y ago
  >but in principle the detectors could iterate and get better over time too At some point the text will become undetectable. The same happens for image generating Networks. The detection works by detecting a statistical discrepancy between the AI output and "real" data. The goal of the AI in training is also to close that gap, the better the network, the harder it is to detect and the more output data you would need to get any significant results.
deleted 4y ago
[deleted]
pyuser583 4y ago
“Poe’s law?” Is that Edgar Allen Poe?
- qayxc 4y ago
  https://en.wikipedia.org/wiki/Poe%27s_law https://en.wikipedia.org/wiki/Poe%27s_law

by qayxc 4y ago

background 4y ago

Right, but in principle the detectors could iterate and get better over time too. That's why I asked about "a ChatGPT detector" instead of "general AI detector", which is a very different problem.

baq 4y ago
The default style is easily detected by presence of overalls, moreovers and furthermores. When you tell it to do a ‘concise HN comment’ the only tell may be that its English is flawless. E.g. In a style of a very concise HN comment describe how to detect that a text has been written by the Assistant. To detect if a text has been written by the Assistant, check for the use of generic language, repetitive phrases, and a lack of personal perspective or opinion.
- AmericanChopper 4y ago
  > To detect if a text has been written by the Assistant, check for the use of generic language, repetitive phrases, and a lack of personal perspective or opinion. There are many people who use generic language, repetitive phrases, and lack personal perspectives and opinions (at least people who lack sophisticated perspectives/opinions). Which makes the problem more complicated, but also perhaps irrelevant. If you can’t tell whether some text was written by a human or a computer, does it even matter?
constantcrying 4y ago
>but in principle the detectors could iterate and get better over time too At some point the text will become undetectable. The same happens for image generating Networks. The detection works by detecting a statistical discrepancy between the AI output and "real" data. The goal of the AI in training is also to close that gap, the better the network, the harder it is to detect and the more output data you would need to get any significant results.

deleted 4y ago

[deleted]

pyuser583 4y ago

“Poe’s law?” Is that Edgar Allen Poe?

qayxc 4y ago
https://en.wikipedia.org/wiki/Poe%27s_law https://en.wikipedia.org/wiki/Poe%27s_law