3 ms·
The authors point is that LLMs dont learn "on the job" so to speak, as a user if you tell something like ChatGPT that it has made a mistake then it will put tha
by jsheard 2y ago
The authors point is that LLMs dont learn "on the job" so to speak, as a user if you tell something like ChatGPT that it has made a mistake then it will put that in its short term memory (the session context) but it won't be committed to long term memory (the actual model weights) that persists across sessions. Training is usually a separate process that end-users have little to no direct influence over.
- buildbot 2y agoThat's how it's currently deployed, but there is no requirement or restriction that you can't learn online. It's just kinda a bad idea, see Microsoft Tay...
- ysofunny 2y agonot the ones publicly available I bet. but it's one of those things that's only hard to do because of the capitalist race ongoing in that space but very easy to consider... what if Gemini learned on the job??? like self-training? (alpha go zero?) these is a low-hanging fruit sort of idea is all I'm saying