3 ms·
>The knowledge is stored in the model's weights in the same way the knowledge you possess is stored in your neurons. We don't know that this is true. But even
by vannevar 4y ago
>The knowledge is stored in the model's weights in the same way the knowledge you possess is stored in your neurons.
We don't know that this is true. But even if it is, there is a critical difference in the knowledge stored. Human knowledge incorporates direct experience of the world through multiple senses, while an LLM's knowledge is solely derived from text and so misses some critical physical constraints and contexts.