6 ms·
A language model by definition encodes knowledge about a language... If you mean "it doesn't also have knowledge of the wolrd, facts etc", well, it has been tr
by coldtea 4y ago
A language model by definition encodes knowledge about a language...
If you mean "it doesn't also have knowledge of the wolrd, facts etc", well, it has been trained with a huge corpus of all kinds of material, so it does.
If you mean "it doesn't understand it, so it's not real knowledge", then that's getting into philosophy/semantics, and it could be argue that it does, or that what humans do is not very different...