3 ms·
These models are highly specialized models that reason similarly to DeepSeek's new model except instead of reasoning over the general domain they do something s
by PaulHoule 2y ago
These models are highly specialized models that reason similarly to DeepSeek's new model except instead of reasoning over the general domain they do something specific like arithmetic.
They're using a similar model and a similar training method to do something simple. It is to DeepSeek what DeepSeek is to ChatGPT-4o, and this kind of reduction to the simplest case is exactly what makes progress go.
(e.g. ChatGPT-4 is a dead end because it is so expensive to train that you can't do training experiments. At $30 a model it is reasonable to train a model 1000s of times)