It knows things in the sense of "you can ask it and it gives you a relevant and factual answer". It can also transfer knowledge to new situations to a degree. B

It knows things in the sense of "you can ask it and it gives you a relevant and factual answer". It can also transfer knowledge to new situations to a degree. But it doesn't know everything, and there are stricter definitions of the word knowing where GPT (almost certainly) knows nothing. But just because the last layer outputs probabilities for tokens, doesn't mean you can't have intelligence in the layers above that. I don't think "it generates a chain of token pobabilies" is really disqualifying.