You can't realistically keep training the same model forever, or it will start forgetting things it knew before. The proper name for this is "catastrophic forge

You can't realistically keep training the same model forever, or it will start forgetting things it knew before. The proper name for this is "catastrophic forgetting".