4 ms·

How?

• sigmoid10 7mo ago
  Same way you distill any model. Training data efficiency matters only while you train the source model/ensemble. Once you have that you are purely compute bound during distillation.