3 ms·
Isn't distillation done through SFT by having the student model approximate the teacher's output distribution?
by maleldil 3mo ago
Isn't distillation done through SFT by having the student model approximate the teacher's output distribution?
loading thread…