They do build on previous knowledge. That’s literally what the training is doing. It’s just easier, engineering wise, to start over from scratch on each iterat

They do build on previous knowledge. That’s literally what the training is doing. It’s just easier, engineering wise, to start over from scratch on each iteration. And it makes it easier to evaluate how each change improves the outcome or not.