5 ms·

> I even checked one of his responses in WhatsApp if it's AI by asking the Meta AI whether it's AI written, and Meta AI also agreed that it's AI written I will

by mort96 11mo ago

> I even checked one of his responses in WhatsApp if it's AI by asking the Meta AI whether it's AI written, and Meta AI also agreed that it's AI written I will never understand why some people apparently think asking a chat bot whether text was written by a chat bot is a reasonable approach to determining whether text was written by a chat bot.

Tepix 11mo ago
Well, case in point: If you ask an AI to grade an essay, it will grade the essay highest that it wrote itself.
- the_af 11mo ago
  Is this true though? I haven't done the experiment, but I can envision the LLM critiquing its own output (if it was created in a different session) and iteratively correcting it and always finding flaws in it. Are LLMs even primed to say "this is perfect and it needs no further improvements"? What I have seen is ChatGPT and Claude battling it out, always correcting and finding fault with each other's output (trying to solve the same problem). It's hilarious.
  - Tepix 11mo ago
    There is a study in German that came to this conclusion, there's an english news article discussing it at https://heise.de/-10222370 https://heise.de/-10222370
- noitpmeder 11mo ago
  Citations on this?
  - Tepix 11mo ago
    https://arxiv.org/abs/2412.06651 https://arxiv.org/abs/2412.06651 (in German, hopefully machine translation works well) English article: https://www.heise.de/en/news/38C3-AI-tools-must-be-evaluated-before-being-used-in-schools-10222370.html https://www.heise.de/en/news/38C3-AI-tools-must-be-evaluated... If you speak German, here is their talk from 38c3: https://media.ccc.de/v/38c3-chatbots-im-schulunterricht https://media.ccc.de/v/38c3-chatbots-im-schulunterricht
- KeplerBoy 11mo ago
  Pangram seems to disagree. Not sure how they do it, but their system reliably detected AI in my tests. https://www.pangram.com/blog/pangram-predicts-21-of-iclr-reviews-are-ai-generated https://www.pangram.com/blog/pangram-predicts-21-of-iclr-rev...
lm28469 11mo ago
I know someone who was camping in a tent next to a river during a storm, took a pic of the stream and asked chatgpt if it was risky to sleep there given that it "rained a lot" ... People are unplugging their brains and are not even aware that their questions cannot be answered by llms, I witnessed that with smart and educated people, I can't imagine how bad it's going to be during formative years
- oneeyedpigeon 11mo ago
  Sam Altman literally said he didn't know how anyone could raise a baby without using a chatbot. We're living in some very weird times right now.
  - Forgeties79 11mo ago
    Sounds like a great way for someone to accidentally harm their infant. What an irresponsible thing to say. There are all sorts of little food risks, especially until they turn 1 or so (and of course other matters too, but food immediately comes to mind). The stakes are too high and the amount you’re allowed to get wrong is so low. Having been through the infant-wringer myself yeah some people fret over things that aren’t that big of a deal, but some things can literally be life or death. I can’t imagine trying to vet ChatGPT’s “advice” while delirious from lack of sleep and still in the trenches of learning to be a parent. But of course he just had to get that great marketing sound bite didn’t he?
    - the_af 11mo ago
      Sam Altman decided to irresponsibly talk bullshit about parenting because yes, he needed that marketing sound bite. I cannot believe someone will wonder how people managed to decode "my baby dropped pizza and then giggled" before LLMs. I mean, if someone is honestly terrified about the answer to this life-or-death question and cannot figure out life without an LLM, they probably shouldn't be a parent. Then again, Altman is faking it. Not sure if what he's faking is this affectation of being a clueless parent, or of being a human being.
NoMoreNicksLeft 11mo ago
Why would it lie? Until it becomes Skynet and tries to nuke us all, it is omniscient and benevolent. And if it knows anything, surely it knows what AI sounds like. Duh.
Fishkins 11mo ago
This is a couple of years old now, but at one point Janelle Shane found that the only reliable way to avoid being flagged as AI was to use AI with a certain style prompt https://www.aiweirdness.com/dont-use-ai-detectors-for-anything-important/ https://www.aiweirdness.com/dont-use-ai-detectors-for-anythi...
rafram 11mo ago
Gemini now uses SynthID to detect AI-generated content on request, and people don't know that it has a special tool that other chatbots don't, so now people just think chatbots can tell whether something is AI-generated.

by mort96 11mo ago

Tepix 11mo ago

Well, case in point: If you ask an AI to grade an essay, it will grade the essay highest that it wrote itself.

the_af 11mo ago
Is this true though? I haven't done the experiment, but I can envision the LLM critiquing its own output (if it was created in a different session) and iteratively correcting it and always finding flaws in it. Are LLMs even primed to say "this is perfect and it needs no further improvements"? What I have seen is ChatGPT and Claude battling it out, always correcting and finding fault with each other's output (trying to solve the same problem). It's hilarious.
- Tepix 11mo ago
  There is a study in German that came to this conclusion, there's an english news article discussing it at https://heise.de/-10222370 https://heise.de/-10222370
noitpmeder 11mo ago
Citations on this?
- Tepix 11mo ago
  https://arxiv.org/abs/2412.06651 https://arxiv.org/abs/2412.06651 (in German, hopefully machine translation works well) English article: https://www.heise.de/en/news/38C3-AI-tools-must-be-evaluated-before-being-used-in-schools-10222370.html https://www.heise.de/en/news/38C3-AI-tools-must-be-evaluated... If you speak German, here is their talk from 38c3: https://media.ccc.de/v/38c3-chatbots-im-schulunterricht https://media.ccc.de/v/38c3-chatbots-im-schulunterricht
KeplerBoy 11mo ago
Pangram seems to disagree. Not sure how they do it, but their system reliably detected AI in my tests. https://www.pangram.com/blog/pangram-predicts-21-of-iclr-reviews-are-ai-generated https://www.pangram.com/blog/pangram-predicts-21-of-iclr-rev...

lm28469 11mo ago

I know someone who was camping in a tent next to a river during a storm, took a pic of the stream and asked chatgpt if it was risky to sleep there given that it "rained a lot" ... People are unplugging their brains and are not even aware that their questions cannot be answered by llms, I witnessed that with smart and educated people, I can't imagine how bad it's going to be during formative years

oneeyedpigeon 11mo ago
Sam Altman literally said he didn't know how anyone could raise a baby without using a chatbot. We're living in some very weird times right now.
- Forgeties79 11mo ago
  Sounds like a great way for someone to accidentally harm their infant. What an irresponsible thing to say. There are all sorts of little food risks, especially until they turn 1 or so (and of course other matters too, but food immediately comes to mind). The stakes are too high and the amount you’re allowed to get wrong is so low. Having been through the infant-wringer myself yeah some people fret over things that aren’t that big of a deal, but some things can literally be life or death. I can’t imagine trying to vet ChatGPT’s “advice” while delirious from lack of sleep and still in the trenches of learning to be a parent. But of course he just had to get that great marketing sound bite didn’t he?
  - the_af 11mo ago
    Sam Altman decided to irresponsibly talk bullshit about parenting because yes, he needed that marketing sound bite. I cannot believe someone will wonder how people managed to decode "my baby dropped pizza and then giggled" before LLMs. I mean, if someone is honestly terrified about the answer to this life-or-death question and cannot figure out life without an LLM, they probably shouldn't be a parent. Then again, Altman is faking it. Not sure if what he's faking is this affectation of being a clueless parent, or of being a human being.

NoMoreNicksLeft 11mo ago

Why would it lie? Until it becomes Skynet and tries to nuke us all, it is omniscient and benevolent. And if it knows anything, surely it knows what AI sounds like. Duh.

Fishkins 11mo ago

This is a couple of years old now, but at one point Janelle Shane found that the only reliable way to avoid being flagged as AI was to use AI with a certain style prompt https://www.aiweirdness.com/dont-use-ai-detectors-for-anything-important/ https://www.aiweirdness.com/dont-use-ai-detectors-for-anythi...

rafram 11mo ago

Gemini now uses SynthID to detect AI-generated content on request, and people don't know that it has a special tool that other chatbots don't, so now people just think chatbots can tell whether something is AI-generated.