3 ms·
LLMs don't pass the Turing so easily (https://arxiv.org/abs/2310.20216 https://arxiv.org/abs/2310.20216).
by RandomLensman 3y ago
LLMs don't pass the Turing so easily (https://arxiv.org/abs/2310.20216 https://arxiv.org/abs/2310.20216).
- CamperBob2 3y agoHot take: they would pass any given variant of the Turing test if you specifically trained them to. The Turing test says more about the human participant than it does about the challenger. Humans, even smart ones, are easy to fool.
- kenjackson 3y agoThis is an interesting study. First It Is fascinating that only 63% thought humans were humans. I think this speaks to the state of AI that this percentage isn’t near 95%. I think this shows that we are astonishingly close to passing the Turing Test, but not there quite yet. But as noted in the paper some of the things that need to change are things like being too good at grammar and punctuation!
- RandomLensman 3y agoIt is also the non-adverserial version of the Turing test, humans might be better in the adversarial one, still. I found the relative high level for ELIZA fascinating, too.