4 ms·
after a cursory read, I can confidently say I could not, in fact, have come up with Kimi Delta Attention.
by rekshaw 2mo ago
after a cursory read, I can confidently say I could not, in fact, have come up with Kimi Delta Attention.
- world2vec 2mo agoNot even close for me too.
- vovavili 2mo agoI thought I was the only one.
- trollbridge 2mo agoThank goodness. There are dozens of us.
- ma-r-s 2mo agodozens!!!
- arnavpraneet 2mo agopossibly scores!!!
- cloudcalvin118 2mo agoScores? More like "grosses"
- nope1000 2mo agoI don't even know most words they used in the paper haha
- dd8601fn 2mo agoYeah, pretty sure the “you” in “you could have” is a different “you” than “we”.
- queenkjuul 2mo agoThey lost me just describing the notation lol
- denysvitali 2mo agoSame!
- londons_explore 2mo agoThe notation looks complex, but underneath it's all just adding and multiplying. Nothing complex
- baq 2mo agoas is practically all of transformer maths if you squint hard enough...
- ReactiveJelly 2mo ago"I invented a new algorithm" "New algorithm, or fmadd?" "... fmadd."
- teach 2mo agoGrand Theft Auto VI looks complex, but underneath it's all just ones and zeros and NAND
- deleted 2mo ago[deleted]
- penguin_booze 2mo ago"you could have..." is among the top insulting phrases used by maths-adjacent people. Others in that league are "it should now be obvious...", "it's abundantly clear...", "it can be easily shown that...", "this is nothing but..." etc. The rest of us reading this are like, holy batman, what the fuck was that?!
- Razengan 2mo agoRight next to "Learn More" by software UI designers.
- ozgung 2mo agoAlso the proof is so trivial that it’s left to the reader.
- BurnerOptical 2mo agoThis one hurts the most, esp. in fields you're not familiar.
- hnfong 2mo agoWell, at least these days an actually trivial (to a domain expert) proof can be delegated to a frontier model...
- cubefox 2mo agoIn the future this might be replaced with "you can verify this fact by asking an LLM of your choice". Similar to how people in chat arguments already post screenshots of an LLM answer to show that their opinion is correct.
- moffkalast 2mo agoCounterexample left as an exercise for Fable
- egeozcan 2mo ago
- frankus 2mo agoRelevant xkcd: https://www.explainxkcd.com/wiki/index.php/2501:_Average_Familiarity https://www.explainxkcd.com/wiki/index.php/2501:_Average_Fam...
- yongjik 2mo agoImagine reading the title again in the voice of the Asian Father Meme. "You could have come up with Kimi Delta Attention, but you didn't, did you."
- devy 2mo agoDoubleword AI is conducting a classic textbook marketing trick called newsjacking. Writing a detailed technical post behind the news of Kimi K3 and KDA algorithm with an audacious title like "You Could Have Invent Breakthrough It too" they are pre-filtering out the ones who couldn't comprehend with quick read (myself included) and attracting the ones who agreed with the blog post. At the end with a strong CTA to promoting their 10x cheapter open weight model AI inference and hiring too. Good job Doubleword, I see what you are doing there.
- Barbing 2mo ago“Kimi Delta Attention” because “Kimi K3 Delta Attention (oh that’s just our little internal name for it as a joke)” passes no sniff tests.
- mezark 2mo agolol - co-founder of Doubleword here. honoured you think we have sophisticated enough marketing to 'newsjack'. What actually happened is my cofounder wrote it over the weekend because he's a mega-nerd and put it live yesterday. I hadn't even read it until I saw this hacker news thread lol We're just a group of guys and gals who like inference!
- arkj 2mo agoThe blogs from doubleword are indeed full precision. A great team doing a fantastic job.
- glaslong 2mo ago* a completely different "you" who spent countless hours gaining expertise on a wholly diverged life path