3 ms·
Sub-token manipulation is a known weakness of the models; they are fed blocks of characters, not individual characters, and so they underperform on tasks that r
by sdenton4 4y ago
Sub-token manipulation is a known weakness of the models; they are fed blocks of characters, not individual characters, and so they underperform on tasks that require fine-character-level manipulations.
- kqr 4y agoBut in that case I would have wanted to see it present a number that's at least of the right order of magnitude, even if all individual digits were incorrect. A human can adapt to their known weaknesses.
- sdenton4 4y agoOptical illusions expose fundamental issues in human perception, which we generally can't adapt to. This is similar. [edit, fwiw]: Also consider that humans can't perceive ultrasonic sound frequencies, or light outside a certain frequency range... We have eventually invented ways to perceive beyond our physical limitations, but no amount of individual adaptation can overcome these boundaries. There are /other/ arguments that ChatGPT doesn't reason well, but the character-level manipulation examples are insufficient.