2 ms·
> If by "training corpus" you mean the actual data I already acknowledged that that's currently legally impossible. Did you read the site this very post links
by thepasch 22d ago
> If by "training corpus" you mean the actual data I already acknowledged that that's currently legally impossible.
Did you read the site this very post links to? The entire point is that the training corpus, recipe, and scripts, as well as intermediate checkpoints, will be made available for K2 Horizon. Chinese models these days don't even release pre-trained weights anymore; all you get now is the finished post-trained product.
I've read your comment. I'm doubting you've even read the thing you were commenting on.
- culi 21d agoYes there have been several research projects like these that have fully open sourced their training data (mostly coming from Europe). But that's all they amount to. Experiments and projects. The labs that are actually competing with frontier models are using data would usually be a violation of copyright to release openly. > Chinese models these days don't even release pre-trained weights anymore; all you get now is the finished post-trained product. No? That's absolutely not true. Qwen, GLM, Kimi, DeepSeek, etc all consistently release both the post-trained "Instruct/Chat" versions and the underlying "Base" (pre-trained) weights. Which specific Chinese models are you thinking about?