That's basically never been the case for any statistical AI system which are all subject to "catestrophic forgetting". The weights of the system which are its

That's basically never been the case for any statistical AI system which are all subject to "catestrophic forgetting". The weights of the system which are its memory are set by having their values determined over an entire training set. This is, effectively, a compression process which takes eg., most of the internet, and compresses it to 1TB of weights. If you update those weights by a process which doesn't "zip everything at once" then you're overwriting weight values by data which is less representative than "everything at once". I'd imagine in ChatGPT's case, OpenAI will review all the transcripts and find someway to do a pass over the whole set at once to make some improvement. If it were being trained live it's whole memory would be wiped out and replaced with racist/sexist/etc. inputs very quickly, as with MS's chatbot