4 ms·
Thinking vs non-thinking. There'll be a token cost there. But still fairly remarkable!
by regularfry 6mo ago
Thinking vs non-thinking. There'll be a token cost there. But still fairly remarkable!
- DoctorOetker 6mo agoIs there a reason we can't use thinking completions to train non-thinking? i.e. gradient descent towards what thinking would have answered?
- joshred 6mo agoFrom what I've read, that's already part of their training. They are scored based on each step of their reasoning and not just their solution. I don't know if it's still the case, but for the early reasoning models, the "reasoning" output was more of a GUI feature to entertain the user than an actual explanation of the steps being followed.