3 ms·
1966 https://en.wikipedia.org/wiki/ELIZA_effect https://en.wikipedia.org/wiki/ELIZA_effect It turns out the limiting factor isn't how sophisticated algorithms
by simonh 1mo ago
1966
https://en.wikipedia.org/wiki/ELIZA_effect https://en.wikipedia.org/wiki/ELIZA_effect
It turns out the limiting factor isn't how sophisticated algorithms are, it's how gullible humans are.
- beardedetim 1mo agoI think of this and the book the author wrote Computer Power and Human Reason every time I try to talk to product about the short comings of LLMs
- ashetr 1mo agoWhat does that have to do with the Turing Test? The TT has clear rules: There are judges that have a dialogue with anonymized AI/humans. The humans cannot cheat and impersonate a machine, they have to act normally. The AI obviously should try to sound human. No AI would pass this test with experienced judges.
- frollogaston 1mo agoThe test doesn't say that the judge has to be experienced. But I also don't care if some random gullible person can't tell the difference. Nothing passes the Turing Test for me yet. Edit: Also doesn't say anything about who the human test subject is
- simonh 1mo agoOf course, and I'm sure OP wouldn't disagree with you, it was clearly a joke for emphasis. Some people round here need to clean and calibrate their humour detectors more often.
- frollogaston 1mo agoI wasn't responding to OP. I get the emphasis, the M6 Mac is very powerful.
- cortesoft 1mo agoHow can you be certain you haven’t failed a Turing test?
- deleted 1mo ago[deleted]
- frollogaston 1mo agoI've never done a test. That means 1. you know it's a test 2. you get like 5 back-and-forths or 5 minutes 3. you have a human subject to compare to. But pretty sure I'd pass anyway, as the judge or subject.
- stavros 1mo agoYou think current frontier models couldn't pass for a human on an online chat? You and I have very different perceptions of reality.
- frollogaston 1mo agoSounds like something we could settle right here and now.
- stavros 1mo agoHa ha! Fool! You've been talking to an LLM all this time! Your wife is actually Haiku 4.5.
- frollogaston 1mo agoHuh, should've known it was odd for my wife to always say I'm right (as the boomers would say)
- stickfigure 1mo agoI think that if you have a long enough chat, yeah, I think you can figure out who's meat. The original rules for the TT specified a short interaction, but I can probably accelerate it by pasting in large code snippets to force early compactions.
- josephg 1mo agoHumans are famously good at reading large code snippets.
- stickfigure 1mo agoThey are famously good at ignoring large code snippets.
- mingus88 1mo agoYou’ve moved the goalposts. You can always say “oh well these judges don’t have the experience to catch this type of AI. The fact that you have to insert this qualifier, to ensure you always have a way to discredit the test, pretty much shows to me that we’re beyond it.
- pibaker 1mo agoColloquially the Turing test is just a stand in for "can a human mistake a computer for a person." No need to overcomplicate it.
- bell-cot 1mo agoYeah...but in context, "gullible" seem a bit pejorative. Humans are also hopelessly incapable of sensing radioactivity, methanol in their alcoholic drinks, carbon monoxide, and a great many other things that our ancestors just didn't encounter much. Though we're pretty good at sizing up a person's emotional balance/maturity and competence at familiar tasks. So maybe have an old blacksmith watch the AI/robot interact with horse owners for a while, then shoe their horses, and see how well it does.
- applicative 1mo agoIt was always a bad test, despite the greatness of Turing. The human organism is built to 'project' humanity onto anything available; apart from this none of the peculiar phenomena of the so-called 'modern human' is even intelligible, even the possibility of science. I bring all that is in me onto you as soon as you seem to be saying something, and reciprocally. We do this at the drop of a hat, and all specifically human life depends on it. But this power shows its 'gullibility' with 'gods' as also with Eliza. I am not snide about it because it is overreach by something the significance of which is overwhelming , but one is indeed amazed by the failure to reflect on the part of the ones eg giving LLMs rights - to take extreme case of a very widespread cultus - as if /they/ were the rational party, not ancients placating the storm god.
- ebruchez 1mo agoOne needs to be a little more sophisticated about it. Ray Kurzweil, for example, set fairly clear rules for his interpretation of the test in his 2001 wager: https://www.writingsbyraykurzweil.com/a-wager-on-the-turing-test-the-rules-2 https://www.writingsbyraykurzweil.com/a-wager-on-the-turing-... Those rules are fairly reasonable, at least as a start.