2 ms·
I'm not sure if corporations will be willing to allow LLMs to go the way of EVs. Then again, all of Chinese models are open. And DeepSeek even publishes resear
by culi 3mo ago
I'm not sure if corporations will be willing to allow LLMs to go the way of EVs.
Then again, all of Chinese models are open. And DeepSeek even publishes research papers alongside their models that go in depth into the methodology. I guess there's not much stopping USian companies from copying
- wolttam 3mo agoDeepSeek isn't the only one publishing; Kimi published about both their Attention Residuals and KDA / sparse attention.