4 ms·
Would LLMs forget things, and would they be affected by the Mandela effect?
by drKarl 3y ago
Would LLMs forget things, and would they be affected by the Mandela effect?
- Vecr 3y agoNot sure what they mean, if all the code and model data are the same, it's won't forget anything encoded in the model. Of course the actual post-training context window is really short, it won't remember anything at all that falls out of the context window.