3 ms·
> I am optimistic Kimi K open models soon will outperform Opus models Hard to outperform the model you distill...
by scosman 5mo ago
> I am optimistic Kimi K open models soon will outperform Opus models
Hard to outperform the model you distill...
- intrasight 5mo agoIs that true? If the distillation is not lossy and the model runs much faster due to less resource consumption, then it may outperform.
- mwigdahl 5mo agoOne of those conditionals is a pretty huge assumption.
- intrasight 5mo agoIt's an assumption and it can be tested
- nl 5mo agoMost of the performance on coding comes from RL, not distillation. Distillation helps with world knowledge and things like that.
- Bolwin 5mo agoThey're not distilled. Stop spreading anthropics misuse of the term. They do use it for synthetic data/judging though, so yes, hard to outperform. Not that they need to. If they can basically match it for a fifth of the price.