3 ms·
Intelligence does not start from a random state, but from a pretrained one. Random state is likely to roll an artificial overfit or if it just fits, you won't k
by AstralStorm 5y ago
Intelligence does not start from a random state, but from a pretrained one. Random state is likely to roll an artificial overfit or if it just fits, you won't know why it is better than another state - or rather why your training method sucks from other initial states.
Proper methods of bias analysis are network compression or random surgery, and expanding test data set.
Proper methods of training are robust to varied initial states.