All that is only needed because incremental learning algorithms don't really work all that well. It's a dirty secret in the field that we still don't have good

All that is only needed because incremental learning algorithms don't really work all that well. It's a dirty secret in the field that we still don't have good answers for catastrophic forgetting in neural networks (the best candidate incremental learner as of right now), and the other alternatives are far worse.