3 ms·
> You're teaching your model to copy an other model's outputs. That's a time honoured tradition in ML, invented by the father of the field himself, Geoffrey Hi
by visarga 4y ago
> You're teaching your model to copy an other model's outputs.
That's a time honoured tradition in ML, invented by the father of the field himself, Geoffrey Hinton, in 2015.
> Distilling the Knowledge in a Neural Network
https://arxiv.org/abs/1503.02531 https://arxiv.org/abs/1503.02531