4 ms·
It might just be by chance: the initial weights of one model could have been lucky in some areas, and unlucky in others. There's no way to tell other than train
by danuker 5y ago
It might just be by chance: the initial weights of one model could have been lucky in some areas, and unlucky in others. There's no way to tell other than training again, which is a costly proposition.
- eigenvalue 5y agoThat seems pretty unlikely to me actually. As the models and training data get much bigger, I think the initial weights become less important (at least assuming your random weights have certain desirable statistical properties, which they do by construction usually).