You’re not supposed to ask people if they read the article on here, because usually the answer is yes (and you should expect it to be). I did read it. The poin

You’re not supposed to ask people if they read the article on here, because usually the answer is yes (and you should expect it to be). I did read it. The point of neural nets is that they are really good at probabilisticly linking tokens (in this case words with some embedded positional encoding). That is not the same as understanding file systems. If you look at any architectural overview of GPT-3, you’ll see it’s just really good at linking words together in order. Even OpenAI will admit it doesn’t know anything outside its dataset (try asking it weather questions).