9 ms·
"It's reinforcement learning on the results of generated chains of thoughts." No, that's not how LLMs work.
by jibal 2y ago
"It's reinforcement learning on the results of generated chains of thoughts."
No, that's not how LLMs work.
- red75prime 2y agoBase models are trained using autoregressive learning. "Reasoning models" are base models (maybe with some modifications) that were additionally trained using reinforcement learning.
- Philpax 2y agoThat is how reasoning models work: https://www.interconnects.ai/p/deepseek-r1-recipe-for-o1 https://www.interconnects.ai/p/deepseek-r1-recipe-for-o1