5 ms·

Do you think you could convince someone, behind a terminal, that you weren’t an LLM?

the_af 3y ago
It has become harder, no doubt about it. But let me invert your question somewhat: do you think you'd be unable to tell over a terminal (in a long interaction) that you're chatting with a LLM? Remove the obvious constraints about no cursing, no hate speech, etc. Imagine an LLM completely uncensored. I still think I'd be able to tell with a high degree of confidence, considering multiple things: whether the "person" asks me questions, whether it refuses to answer directly (a real person will be less eager to talk about some touchy subjects, or may be shy, or upset), which topics it's eager to talk about, whether it shows lecherous behavior, whether it gets obnoxious or single minded, whether it has poor taste in things, whether it displays too much of an equanimous attitude in all topics, whether it is a bigot, or knows too much about stuff. I think I'd be able to tell.
- famouswaffles 3y ago
  >whether the "person" asks me questions LLMs can ask questions just fine. This isn't hard to implement >whether it refuses to answer directly (a real person will be less eager to talk about some touchy subjects, or may be shy, or upset), which topics it's eager to talk about, whether it shows lecherous behavior, whether it gets obnoxious or single minded, whether it has poor taste in things, whether it displays too much of an equanimous attitude in all topics, whether it is a bigot, or knows too much about stuff. You have to understand that an LLM would have zero issues doing all these things. Open AI and other L vendors instruct tune/RLHF to speak in a certain manner but it's not a limitation of an LLM itself
- DrWeevilJammer 3y ago
  [dead]
- Exoristos 3y ago
  One quickly intuits the difference between an LLM and a human; unless that human were an insufferably long-winded law clerk with a sixth-grade nerd's fetish for seeming all-knowledgeable.
  - famouswaffles 3y ago
    >unless that human were an insufferably long-winded law clerk with a sixth-grade nerd's fetish for seeming all-knowledgeable. This is just how the models are instruct tuned, not an immutable characteristic of LLMs
  - the_af 3y ago
    Haha, good point. Also, it wouldn't help if the human "helpfully" tried to help you with bullshit, and when you called them out, they replied "I'm sorry, you are correct I made a mistake about [...]".
creata 3y ago
As it's phrased, I think your question is useless, because it's more a function of the insane hype around LLMs. That is, as long as people think that LLMs can pass for humans, it's going to be hard to convince them that you're not an LLM. Shitty analogy: if someone thinks that there are shapeshifters everywhere, there isn't really anything you can do to convince them that you aren't a shapeshifter.

It has become harder, no doubt about it. But let me invert your question somewhat: do you think you'd be unable to tell over a terminal (in a long interaction) that you're chatting with a LLM? Remove the obvious constraints about no cursing, no hate speech, etc. Imagine an LLM completely uncensored. I still think I'd be able to tell with a high degree of confidence, considering multiple things: whether the "person" asks me questions, whether it refuses to answer directly (a real person will be less eager to talk about some touchy subjects, or may be shy, or upset), which topics it's eager to talk about, whether it shows lecherous behavior, whether it gets obnoxious or single minded, whether it has poor taste in things, whether it displays too much of an equanimous attitude in all topics, whether it is a bigot, or knows too much about stuff. I think I'd be able to tell.

famouswaffles 3y ago
>whether the "person" asks me questions LLMs can ask questions just fine. This isn't hard to implement >whether it refuses to answer directly (a real person will be less eager to talk about some touchy subjects, or may be shy, or upset), which topics it's eager to talk about, whether it shows lecherous behavior, whether it gets obnoxious or single minded, whether it has poor taste in things, whether it displays too much of an equanimous attitude in all topics, whether it is a bigot, or knows too much about stuff. You have to understand that an LLM would have zero issues doing all these things. Open AI and other L vendors instruct tune/RLHF to speak in a certain manner but it's not a limitation of an LLM itself
DrWeevilJammer 3y ago
[dead]
Exoristos 3y ago
One quickly intuits the difference between an LLM and a human; unless that human were an insufferably long-winded law clerk with a sixth-grade nerd's fetish for seeming all-knowledgeable.
- famouswaffles 3y ago
  >unless that human were an insufferably long-winded law clerk with a sixth-grade nerd's fetish for seeming all-knowledgeable. This is just how the models are instruct tuned, not an immutable characteristic of LLMs
- the_af 3y ago
  Haha, good point. Also, it wouldn't help if the human "helpfully" tried to help you with bullshit, and when you called them out, they replied "I'm sorry, you are correct I made a mistake about [...]".

creata 3y ago

As it's phrased, I think your question is useless, because it's more a function of the insane hype around LLMs. That is, as long as people think that LLMs can pass for humans, it's going to be hard to convince them that you're not an LLM. Shitty analogy: if someone thinks that there are shapeshifters everywhere, there isn't really anything you can do to convince them that you aren't a shapeshifter.