3 ms·
I mean, given they can't _count_, it would be pretty astonishing were it otherwise.
by rsynnott 3y ago
I mean, given they can't _count_, it would be pretty astonishing were it otherwise.
- dahart 3y agoExactly, it’s interesting that ‘llms can’t x’, with lots of effort trying to demonstrate it, comes up so often, when we know from first principles they can’t do anything but run a Markov chain on existing words. We’ve managed to build something that is best at fooling people into thinking it can do things it can’t.
- mitthrowaway2 3y agoThey can count occurrences of a token. Depending on the tokenization, they can't necessarily count occurrences of a character.