3 ms·
> it’s at best a post-hoc estimation of what a human inner monologue might be in this circumstance Nope. It's not autoregressive training on examples of human
by red75prime 1y ago
> it’s at best a post-hoc estimation of what a human inner monologue might be in this circumstance
Nope. It's not autoregressive training on examples of human inner monologue. It's reinforcement learning on the results of generated chains of thoughts.
- jibal 1y ago"It's reinforcement learning on the results of generated chains of thoughts." No, that's not how LLMs work.
- red75prime 1y agoBase models are trained using autoregressive learning. "Reasoning models" are base models (maybe with some modifications) that were additionally trained using reinforcement learning.
- Philpax 1y agoThat is how reasoning models work: https://www.interconnects.ai/p/deepseek-r1-recipe-for-o1 https://www.interconnects.ai/p/deepseek-r1-recipe-for-o1