3 ms·
Current LLMs use an optimisation of processing data one word at a time. This makes them bad at solving puzzles involving individual letters or digits. This is
by jiggawatts 3y ago
Current LLMs use an optimisation of processing data one word at a time. This makes them bad at solving puzzles involving individual letters or digits.
This is a well known, well understood limitation that can be overcome (Facebook published a hierarchical model that can parse individual characters), but this technique isn’t used by ChatGPT.
Whenever I see a criticism like this, it says more to me about the hubris of humans and the falsity of their assumed superior intelligence.
You’re criticising the intelligence of a thing you don’t understand yourself!
You didn’t “read the manual”. You didn’t go find out why the AI is failing. You just spouted an angry comment and gave up without gaining any understanding.
PS: the “stupid AI” understands all of this. Just ask it to explain it to you: https://chat.openai.com/share/7bc1c1cb-d888-4ccb-904a-79e9ae22b950 https://chat.openai.com/share/7bc1c1cb-d888-4ccb-904a-79e9ae...