4 ms·
It's as much that LLMs are bad at counting letters in words as it is that humans are good at it. LLMs are also bad at many things that humans don't notice imme
by thomassmith65 1y ago
It's as much that LLMs are bad at counting letters in words as it is that humans are good at it.
LLMs are also bad at many things that humans don't notice immediately.
That is a problem because it leads humans to trust LLMs with tasks at which LLMs currently are bad, such as picking stocks, screening job applicants, providing life advice...
- dragonwriter 1y agoThe particular problem (and one that AI firms marketing approaches have actively leveraged and made worse[0]) is that correlations between capacities that humans are used to from observing other humans do not hold for LLMs, so assumptions about what an LLM should be able to do based what is observed to do and what a human ovserved to do that qould also be expected to be capable of do not hold even as loose rules of thumb. [0] e.g., by promoting AIs as having equivalent capacities of humans of various education levels because they could pass tests that were part of the standards for, and correlate for humans with other abilities of, people with that educational background.