3 ms·
So, unlike what leaders of western labs labs would like you to believe (that Kimi is just the result of distillation attacks), they are introducing new and nove
by constantlm 4mo ago
So, unlike what leaders of western labs labs would like you to believe (that Kimi is just the result of distillation attacks), they are introducing new and novel approaches.
- boomskats 4mo agoNo! It's just not fair!! What about our financial bubble!
- hlynurd 4mo ago"attack"
- nostromo 4mo agoEven if they are distilling, I don't particularly care. Anthropic and others have been distilling copyrighted material by to build these models, largely without permission.
- wnsdy95 4mo ago[flagged]
- mensetmanusman 4mo agoIf you redefine the technical world distilling to mean training on text, you are correct.
- deleted 4mo ago[deleted]
- brookst 4mo agoWe’re all distillers now.
- xdennis 4mo agoPeople don't remember now, but in the old HN comments like "this is so true honestly" would have been downvoted. If a comment just agrees with the parent, people would have said that's what the upvote button is for. Adding a "I agree" comment is just noise.
- protocolture 4mo agoThis is so true honestly.
- xdennis 4mo agoAlso Reddit-style humorous replies were frowned upon because they ruin serious discussion and encourage karma chasing as opposed to providing valuable insight.
- ThePinion 4mo agoWith all the botting and slop going on right now on HN I'd say these once annoyances are now quite arbitrary. I'm sure it bothered you and maybe one other person at this point in time, but it's pretty damn easy to scroll past it compared to actively reading comments that you half way through realize are just LLMs.
- newswasboring 4mo agoTo be honest, comment like yours were also frowned upon haha. If you think something is bad for discussion, downvote. If you think something is objectionable, flag it. And now I have made a faux pas by explaining the rule to you rather than just downvoting and moving on. Its turtles all the way down today.
- mejutoco 4mo agoThis is why on Slashdot you could vote on insightful, humorous, etc. Something neither reddit, not hn have caugh on yet. Digg could have done it.
- Bluestein 4mo ago
- ransom1538 4mo agoExactly,let Anthropic get back to training on the New York times.
- FinchNova12 4mo ago"Kimi is largely a byproduct of distillation" and "Kimi is introducing new and novel approaches" are not mutually exclusive, and I'm not sure it's clear from the paper how much of the improvement comes from the new approaches. So I wouldn't take the new approaches to be much evidence about whether the distillation attacks occurred.
- anon373839 4mo ago> distillation attacks Like the distillation “attacks” Anthropic conducted against literally millions and millions of different creators?
- boomskats 4mo agoOr against all those old books that they ingested and then literally destroyed
- mensetmanusman 4mo agoScanning google is an ‘attack’
- waterTanuki 4mo agoReading Claude's outputs is an 'attack'
- nl 4mo agoEven Anthropic hasn't claimed "Kimi is largely a byproduct of distillation" There's been some distillation. Just like how Elon said in court they distill to make Grok.
- FinchNova12 4mo agoI thought there is discussion circulating around whether the main reason Kimi is impressive is due to distillation. Though possibly if this occurred, this was just one component of their training pipeline and not a majority
- ozgung 4mo agoMoreover, Distillation is a misused term here. Distillation means training a smaller student model using a larger teacher model to completely mimic its behavior. As in you take a base model and create its smaller “turbo” version. Like distillation in Chemistry it means it’s %100 purified version of its teacher.