3 ms·

Can it? I feel like I instantly recognize if I am chatting with an LLM or a human

• tapland 2mo ago
  Can't even tell if you're real or a bot by reading one comment. Great times!
• IMTDb 2mo ago
  Emphasis on "feel"
• piva00 2mo ago
  I was quite surprised on how difficult it is to tell when chatting with an uncensored LLM a friend is running (it's too big to run on any of my computers but he got some B200s). You can input your own "system prompt" to make it behave like a normal internet user and the prose writes very similarly to internet comments with none of the LLMisms from ChatGPT, Claude, Grok, etc.
  • shafyy 2mo ago
    Yes, I'm sure it's possible to get LLMs to respond more like an average human would.
• coldtea 2mo ago
  "Feel" is doing a lot of work here. You can recognize 70% of those (true positive rate) and still have a false negative rate of 30%, while thinking you got 100% of the AI ones! The problem is that you'd be oblivious to those you don't recognize.
  • raducu 2mo ago
    But the Turing test involves a conversation you can steer and I think that's where indeed it's a lot easier to smell LLMs.
  • shafyy 2mo ago
    70%? Are we just making up numbers now?