3 ms·
Smaller models can be trained to match log probs of the larger model. Larger model can be used to generate synthethic data for the smaller model.
by tintor 2y ago
Smaller models can be trained to match log probs of the larger model.
Larger model can be used to generate synthethic data for the smaller model.