2 ms·
Yes. And the original announcement and paper called out that this ~6 million was just for training the R1 model. It specifically mentioned that this didn't inc
by drakenot 2y ago
Yes. And the original announcement and paper called out that this ~6 million was just for training the R1 model. It specifically mentioned that this didn't include any other costs, including research, previous models, etc. Just raw training costs for the latest model.
There is Hugging Face's "Open-R1" project which is attempting to replicate the DeepSeek-R1 model given the innovations outlined in the paper(s). They need to replicate the training code, the datasets, etc. This part of the system wasn't published.
And you are right that with the open weights of the R1 model, it should be pretty easy to infer how much it costs to _run_ as well.