4 ms·
"Kimi is largely a byproduct of distillation" and "Kimi is introducing new and novel approaches" are not mutually exclusive, and I'm not sure it's clear from th
by FinchNova12 2mo ago
"Kimi is largely a byproduct of distillation" and "Kimi is introducing new and novel approaches" are not mutually exclusive, and I'm not sure it's clear from the paper how much of the improvement comes from the new approaches. So I wouldn't take the new approaches to be much evidence about whether the distillation attacks occurred.
- anon373839 2mo ago> distillation attacks Like the distillation “attacks” Anthropic conducted against literally millions and millions of different creators?
- boomskats 2mo agoOr against all those old books that they ingested and then literally destroyed
- mensetmanusman 2mo agoScanning google is an ‘attack’
- waterTanuki 2mo agoReading Claude's outputs is an 'attack'
- nl 2mo agoEven Anthropic hasn't claimed "Kimi is largely a byproduct of distillation" There's been some distillation. Just like how Elon said in court they distill to make Grok.
- FinchNova12 2mo agoI thought there is discussion circulating around whether the main reason Kimi is impressive is due to distillation. Though possibly if this occurred, this was just one component of their training pipeline and not a majority