2 ms·

Isn't this just "catastrophic forgetting?" e.g. training LLMs on anything leads them to get worse at what they learned before.