4 ms·
Continuous pretraining has issues because it starts forgetting the older stuff. There is some research into other approaches.
by astrange 10mo ago
Continuous pretraining has issues because it starts forgetting the older stuff. There is some research into other approaches.