So you‘re generally in favor of mixing training data without separating them in phases, but when I use pretrained weights (as you recommend instead of random we

So you‘re generally in favor of mixing training data without separating them in phases, but when I use pretrained weights (as you recommend instead of random weights) I generally do not have access to whatever the neural net was pretrained with by someone else, so I have to make do with my finetuning data, yes? Thank you!