4 ms·

So far it is literally 3 different uses of the phrase “creating a model”. I could further obfuscate it by fine tuning the work of these researchers on a single

So far it is literally 3 different uses of the phrase “creating a model”. I could further obfuscate it by fine tuning the work of these researchers on a single step and claimed I “created a model” for $0.05. :( I feel like that’s what everyone who is naming their model “R1” is doing right now… This article is trying to make the headline sound as if they replicated the model, when they “just” replicated the theory of one of their findings. It’s a great result even without the author’s obfuscation.

PaulHoule 2y ago
These models are highly specialized models that reason similarly to DeepSeek's new model except instead of reasoning over the general domain they do something specific like arithmetic. They're using a similar model and a similar training method to do something simple. It is to DeepSeek what DeepSeek is to ChatGPT-4o, and this kind of reduction to the simplest case is exactly what makes progress go. (e.g. ChatGPT-4 is a dead end because it is so expensive to train that you can't do training experiments. At $30 a model it is reasonable to train a model 1000s of times)