3 ms·
There is a big difference between being able to train on the reasoning vs just the answers, which they can't against o1 because it's hidden. There is also a hu
by nullc 2y ago
There is a big difference between being able to train on the reasoning vs just the answers, which they can't against o1 because it's hidden. There is also a huge difference between being able to train on the probabilities (distillation) vs not, which again they can and did do with the llama models and can't directly with OpenAI because the conceal the probability output.