3 ms·

> unlike humans, language models can’t be humiliated and do not learn from mistakes. wut. I was pretty sure they do learn from mistakes. but they call it 'trai

• jsheard 2y ago
  The authors point is that LLMs dont learn "on the job" so to speak, as a user if you tell something like ChatGPT that it has made a mistake then it will put that in its short term memory (the session context) but it won't be committed to long term memory (the actual model weights) that persists across sessions. Training is usually a separate process that end-users have little to no direct influence over.
  • buildbot 2y ago
    That's how it's currently deployed, but there is no requirement or restriction that you can't learn online. It's just kinda a bad idea, see Microsoft Tay...
  • ysofunny 2y ago
    not the ones publicly available I bet. but it's one of those things that's only hard to do because of the capitalist race ongoing in that space but very easy to consider... what if Gemini learned on the job??? like self-training? (alpha go zero?) these is a low-hanging fruit sort of idea is all I'm saying
    • jsheard 2y ago
      Self-training is a lot easier to pull off in the context of something like AlphaGo which has a clearly defined goal to reach, LLMs don't really have that luxury as their output can't be evaluated by a rigid set of rules.
      • ysofunny 2y ago
        how about "user engagement"?
• voiceblue 2y ago
  In the context of prediction, there is no such thing as a “mistake”, any more than a d20 die can make a mistake. You might get a 1 when you wanted a 20, but you can hardly blame the machine, only the manufacturer who forgot to weight it with the appropriate (or inappropriate) bias!