4 ms·
> If they are ingesting peoples data to train their model, at what point are they checkpointing? Multiple times per day if they're not incompetent. And I don't
by Turing_Machine 3y ago
> If they are ingesting peoples data to train their model, at what point are they checkpointing?
Multiple times per day if they're not incompetent. And I don't think they're incompetent.
- supermatt 3y agoAre you implying that removing the diff between checkpoints achieves the same effect? Ive never heard of this, but I suppose it may be possible. I suppose the "ghost" of the removed weights would also have shaped subsequent training though... Interesting idea...