3 ms·
How can you emulate learning when LLMs have no way to update their weights? LLMs don't even know what they do and don't know (hence hallucinations), so how woul
by HarHarVeryFunny 2y ago
How can you emulate learning when LLMs have no way to update their weights? LLMs don't even know what they do and don't know (hence hallucinations), so how would they even realize that something was new in the first place?
I could maybe see chatbots storing everything you ever said in a vector database for future lookup, but that's just memory.
- falcor84 2y agoThere's nothing stopping you as an LLM system designer from having it "go to sleep" once a day and use that downtime to consolidate the memory in the vector database into fine-tuning of the weights.