3 ms·
LLMs aren't world models. They're linguistic models. However, with the right training database, it turns out that a good parsimonious linguistic model will ha
by wnoise 3y ago
LLMs aren't world models. They're linguistic models. However, with the right training database, it turns out that a good parsimonious linguistic model will have a (multiple, probably) world model as a subset, as it is so much better at compressing/predicting the textual stream.