One of the fundamental issues with token prediction is the weight of something is based upon consensus of your data set. So "token truth" is build up based upo

One of the fundamental issues with token prediction is the weight of something is based upon consensus of your data set. So "token truth" is build up based upon more data points. That works pretty well lot of daily tasks. LLM reinforces existing knowledge, it doesn't expand on it. So it's not very good at detailed questions where it's data is limited, or novel thoughts are required, let alone true innovation (Einstein, Newton etc). It also has a hard time deciding what is better choice between similar datasets. Most adult humans perform those tasks a lot better, which is why they are using large amount of reinforcement models made by humans.