3 ms·
It can’t count because what the LLM sees is a bunch of tokens not words
by saliagato 3y ago
It can’t count because what the LLM sees is a bunch of tokens not words
- maaaaattttt 3y agoExactly. And asking what/who/which is the “Ninth” something will always fail (or randomly succeed)
- OJFord 3y agoMuch more likely to work for something like German chancellors, US presidents, etc. that people do actually number and could easily have been trained on that data. If you ask 'who was the 45th US president' it doesn't need to be able to count a list of US presidents to answer 'Trump', you can just duckduckgo that and get the answer anyway, that's not doing any counting either.