4 ms·

If Anthropic is calling it distillation [1] then that would argue for it being correct (or at least canonical) terminology. [1] https://www.anthropic.com/news/

• dannyw 4mo ago
  No, a company choosing to use some terminology doesn’t make it correct nor canonical in any sense; especially when they have a vested interest in not being neutral or credible. If Google starts calling ads “Best Links” that doesn’t make it correct nor canonical; the correct term is still ads. Traditionally, distillation is when you get the actual logits of a model response (not exposed via API for years) and then use that to train a model.