3 ms·
Just ask it how many r's are in strawberry and you will realize there isn't a lot of reasoning going on here, it's just trickery on top of token generators.
by lossyalgo 1y ago
Just ask it how many r's are in strawberry and you will realize there isn't a lot of reasoning going on here, it's just trickery on top of token generators.
- Workaccount2 1y agoThis is akin to "Show a human an optical illusion that exploits their physiology". LLM's be like "The dumb humans can't even see the dots"[1] [1]https://compote.slate.com/images/bdbaa19e-2c8f-435e-95ca-a93429d486fe.jpg?crop=590%2C410%2Cx0%2Cy0&width=2200 https://compote.slate.com/images/bdbaa19e-2c8f-435e-95ca-a93...
- lossyalgo 1y agohaha that's a great analogy! How about non-determinism (i.e. hallucinations)? Ask a human ANY question 3 times and they will give you the same answer, every time, unless you prod them or rephrase the question. Sure the answer might be wrong 3 times, but at least you have consistency. Then again, maybe that's a disadvantage for humans!
- adrianmonk 1y agoAsk an illiterate person the same thing and they will fail badly too. Is it impossible to have intelligence without literacy? (Bonus: if so, how was writing invented?)
- lossyalgo 1y agoYes but an illiterate person can be taught to read. Also LLMs generally fail (non-deterministically) at math in general, but humans can also be taught math.