2 ms·

iiuc distillation is sort of that. How big is the delta between teacher and student and then try to reconcile them