3 ms·

> Deepseek proposes RLVR as a way to get around the lack of $ they have to produce human reasoning trace data. What was the difference between what deepseek di

by stymaar 1mo ago

> Deepseek proposes RLVR as a way to get around the lack of $ they have to produce human reasoning trace data. What was the difference between what deepseek did for R1 and what OpenAI did for o1?

npn 1mo ago
openai did human crafted chain of thought dataset training. deepseek didn't have the resources so they attempted RL. doing RL correctly is hard because of the risk of model collapsing.
- Philpax 1mo ago
  Er, o1 was also RL.