3 ms·
So they’re doing both masking for the inputs and knowledge distillation? Is it the combination of these two methods that’s novel?
by l-lousy 5y ago
So they’re doing both masking for the inputs and knowledge distillation? Is it the combination of these two methods that’s novel?