3 ms·Isn’t that distillation ?by naveen99 3mo agoIsn’t that distillation ?mrfox321 3mo agoNo. Distillation trains on a teach model's logits or output tokens.naveen99 2mo agoHow do you have teacher model output anything without it being output tokens (or embeddings / intermediate logits / activations)?