3 ms·
Responding to this: > But isn't that what the training algorithm does? It's true that training and other methods can iteratively trend towards a particular f
by RaftPeople 2y ago
Responding to this:
> But isn't that what the training algorithm does?
It's true that training and other methods can iteratively trend towards a particular function/result. But in this case the training is on next token prediction which is not the same as training on non-verbal abstract problem solving (for example).
There are many things humans do that are very different from next token prediction, and those things we do all combine together to produce human level intelligence.
- notthatoldguy 2y ago> There are many things humans do that are very different from next token prediction, and those things we do all combine together to produce human level intelligence. Exactly LLMs didn't resolve knowledge representation problems. We still don't know how it's going in our brains, but at least we know, we may do internal symbolic knowledge representation and reasoning. LLMs don't. We need a kind of different math for ANNs, a new convolution but for text where layers extract features through the lexical analysis and ontology utilisation, and then train the network.