5 ms·

the article is AI-generated isn't it ?

by fsndz 2y ago

philip1209 2y ago
Nope
- fsndz 2y ago
  Lol, by just reading I knew it was. Then I used an AI detection tool and it says 100% sure it is AI-generated. You know how hard it is to get 100% sure it is AI-generated ?
  - tim333 2y ago
    You can kind of tell it's not AI when it gets beyond the generic stuff and on to say >Today I'm working on Chroma Cloud, designed for exploring and managing large datasets, and Next.js powers its advanced interactions and data loading requirements. which is unlikely to have been written by an LLM.
    - fsndz 2y ago
      you can inject personal stuff to make it feel original, but huge chunks are still AI-generated. Just get the first 4/5 paragraphs and paste in gptzero
      - tim333 2y ago
        Well on the one hand you have gptzero saying it's in the style of AI which I don't count as reliable and on the other you have the author saying it's not which I weight higher. And it mostly makes too much sense apart from "most drivers don't know how many gears their car has" which has me thinking huh? It's usually written on the shifter.
        philip1209 2y ago
        I stand by that statement :-)
  - berdario 2y ago
    Most "AI detection tools" are just the equivalent of a Magic 8 ball. In fact, most of them are just implemented by feeding an LLM the text, and asking "is it AI generated?". You cannot trust that answer any more than any other LLM hallucination. LLMs don't have a magic ability to recognise their own output. Even if your "detection tool" was using exactly the same model, at the same exact version... unless the generation was done with 0 temperature, you just wouldn't be able to confirm that the tool would actually generate the same text that you suspect of being LLM-generated. And even then, you'd need to know exactly the input tokens (including the prompt) used. Currently, the only solution is watermarking, like what Deepmind created: https://deepmind.google/discover/blog/watermarking-ai-generated-text-and-video-with-synthid/ https://deepmind.google/discover/blog/watermarking-ai-genera... but even that, it requires cooperation from all the LLM vendors. There's always going to be one (maybe self-hosted) LLM out there which won't play ball. If you're going to accuse someone of pushing LLM-generated content, don't hide behind "computer said so", not without clearly qualifying what kind of detection technique and which "detection tool" you used.
    - fsndz 2y ago
      I am starting to believe this is a lie spread by AI companies because if AI-slop starts to be detected at scale, it kills their primary use case. True, AI detection tools are not perfect, like any classification algo, they don't have a 100% accuracy. But it does not mean they are useless. They give useful probabilities. If AI detectors are so wrong, how do you explain that passing AI generated text on gptzero and it gets it all the time, same when I pass human written content it recognises it as such almost 99% of the time.
      - titmouse 2y ago
        It's the false positives that make it useless. Even if it's generally very good at detecting AI, the fact that it can and does throw false positives (and pretty frequently) means that nothing it says means anything.
        fsndz 2y ago
  - peteforde 2y ago
    I do worry that the thought process involving feeding everything you consume into an AI powered "AI detector" is a slippery slope to a dystopian hell of one's own making. You don't have to extrapolate too many iterations before you start arguing that you can't trust you're living in base reality. My take on both issues is that even if you're right, the choice is whether to spend your life in a state of cynical paranoia, or not. If you figure out the consciousness equivalent of Ctrl-Shift-Esc, please report back.

the article is AI-generated isn't it ?

by fsndz 2y ago

the article is AI-generated isn't it ?

philip1209 2y ago

Nope

fsndz 2y ago
Lol, by just reading I knew it was. Then I used an AI detection tool and it says 100% sure it is AI-generated. You know how hard it is to get 100% sure it is AI-generated ?
- tim333 2y ago
  You can kind of tell it's not AI when it gets beyond the generic stuff and on to say >Today I'm working on Chroma Cloud, designed for exploring and managing large datasets, and Next.js powers its advanced interactions and data loading requirements. which is unlikely to have been written by an LLM.
  - fsndz 2y ago
    you can inject personal stuff to make it feel original, but huge chunks are still AI-generated. Just get the first 4/5 paragraphs and paste in gptzero
    - tim333 2y ago
      Well on the one hand you have gptzero saying it's in the style of AI which I don't count as reliable and on the other you have the author saying it's not which I weight higher. And it mostly makes too much sense apart from "most drivers don't know how many gears their car has" which has me thinking huh? It's usually written on the shifter.
      - philip1209 2y ago
        I stand by that statement :-)
- berdario 2y ago
  Most "AI detection tools" are just the equivalent of a Magic 8 ball. In fact, most of them are just implemented by feeding an LLM the text, and asking "is it AI generated?". You cannot trust that answer any more than any other LLM hallucination. LLMs don't have a magic ability to recognise their own output. Even if your "detection tool" was using exactly the same model, at the same exact version... unless the generation was done with 0 temperature, you just wouldn't be able to confirm that the tool would actually generate the same text that you suspect of being LLM-generated. And even then, you'd need to know exactly the input tokens (including the prompt) used. Currently, the only solution is watermarking, like what Deepmind created: https://deepmind.google/discover/blog/watermarking-ai-generated-text-and-video-with-synthid/ https://deepmind.google/discover/blog/watermarking-ai-genera... but even that, it requires cooperation from all the LLM vendors. There's always going to be one (maybe self-hosted) LLM out there which won't play ball. If you're going to accuse someone of pushing LLM-generated content, don't hide behind "computer said so", not without clearly qualifying what kind of detection technique and which "detection tool" you used.
  - fsndz 2y ago
    I am starting to believe this is a lie spread by AI companies because if AI-slop starts to be detected at scale, it kills their primary use case. True, AI detection tools are not perfect, like any classification algo, they don't have a 100% accuracy. But it does not mean they are useless. They give useful probabilities. If AI detectors are so wrong, how do you explain that passing AI generated text on gptzero and it gets it all the time, same when I pass human written content it recognises it as such almost 99% of the time.
    - titmouse 2y ago
      It's the false positives that make it useless. Even if it's generally very good at detecting AI, the fact that it can and does throw false positives (and pretty frequently) means that nothing it says means anything.
      - fsndz 2y ago
- peteforde 2y ago
  I do worry that the thought process involving feeding everything you consume into an AI powered "AI detector" is a slippery slope to a dystopian hell of one's own making. You don't have to extrapolate too many iterations before you start arguing that you can't trust you're living in base reality. My take on both issues is that even if you're right, the choice is whether to spend your life in a state of cynical paranoia, or not. If you figure out the consciousness equivalent of Ctrl-Shift-Esc, please report back.