3 ms·
This article shows that when Kimi3's chain of thought is prefilled to match Opus's, the rest of the chain of thoughts Kimi3 outputs very closely aligns with Opu
by varenc 2mo ago
This article shows that when Kimi3's chain of thought is prefilled to match Opus's, the rest of the chain of thoughts Kimi3 outputs very closely aligns with Opus's. That seems strong evidence that Kimi3 is partly a distillation of Opus. And Kimi3 is not a small model. No doubt a lot of hard work went into Kimi, but seems clear that distillation was used effectively as well.
(though maybe there's another interpretation of the thought alignment?)
- wonnage 2mo agoDidn’t Kimi3 release a week before opus 5?
- Otterly99 2mo agoThey compare it to Opus 4.8 in the article, which has been available for a few months now.
- irthomasthomas 2mo agoBut they don't perform the same test on other models as far as I could tell? So we don't lnow if this is peculiar to kimi models or not.