3 ms·
Ask HN: Can LLMs “remember” previous prompts?
This might be a stupid question, I'm completely new to this. Is it possible for LLMs to incorporate human feedback by update their models in real time during a conversation session?
If not, why not?
EDIT:
Put another way,
1. If initial training runs some training loop 10 trillion times to modify a model by a lot
2. And if fine-tuning runs some training loop 10 thousand times to modify that pretrained model by a bit more
3. Can LLMs be architectured to take human feedback as input to run some training loop 10 times to nudge the actual model some more?
- kir-gadjello 4y agoNo, a typical LLM is a pure function of its input, if you (and not the LLM hosting company) control all of input context, and if your sampler uses pseudorandom number generator. But you could create an LLM for which it wouldn't be the case.
- geepytee 4y agoLLMs can 'search' thru previous prompts. If they don't fit on GPT3's token limit, I've seen apps use OpenAI embeddings model for this. It works to the point that it feels like it 'remembers.' Granted that even embeddings will have a cap.
- gteton12 4y agoDo you have a source on this? Would love to read more about it, I was under the impression it just "absorbed" the previous prompts into the current until token limit has been reached.
- MagicMoonlight 4y agoThey use previous prompts in that conversation as part of their “context” but the actual model doesn’t update
- wsgeorge 4y agoIt seems like it'll be a big advantage if the actual models could, especially for on-device or privately deployed LLMs that should learn about the preferences of their users and their changing environments. Do you have any idea why the models don't change? They may not need to, if "context" is enough to prompt them, but it's not clear to me why not.