2 ms·

I think it's more that distilling is enormously cheaper than training from scratch to achieve the same results