4 ms·
Except that latent space does not change in response to new information, something that thoughts famously do. If you read a book that captures the author's tho
by MarkusQ 6mo ago
Except that latent space does not change in response to new information, something that thoughts famously do. If you read a book that captures the author's thoughts, disagree, and write an eloquent arguments to the author, you might change the author's mind. But you will not change the "book's thoughts" on the subject.
Latent spaces are maps of thoughts other people have had, not the thoughts themselves.
- lumost 6mo agoThis gets a bit tricky. Over very long task contexts (1M tokens) or with prompt compression (10s of millions of tokens) the model can alter its priors based on updated evidence. This form of knowledge based learning is not necessarily robust, but demonstrably does occur.
- MarkusQ 6mo ago"the model can alter its priors" The model doesn't have high-level priors in the Bayesian sense (though you could have priors about it). The low-level priors it does have (the weights) are not modified by the context.