3 ms·
Care to explain why not? An LLM's working memory is just its context window, but the LLM also has embedded data in its parameters, which are set during trainin
by mitthrowaway2 3y ago
Care to explain why not?
An LLM's working memory is just its context window, but the LLM also has embedded data in its parameters, which are set during training to minimize loss. This is effectively a memory of the training data, just as much as a digital photo of my face is a memory of the photons reflecting from my face.