4 ms·
There was an HN thread that talked about how “just” is a 4 letter word. It significantly risks underestimating emergent properties and behaviors. Every time yo
by janalsncm 2y ago
There was an HN thread that talked about how “just” is a 4 letter word. It significantly risks underestimating emergent properties and behaviors.
Every time you see “X is just Y” you should think of emergent behaviors. Complexity is difficult to predict.
> R1 Zero has similar reasoning capabilities of R1 without requiring any SFT
In fact R1 zero was slightly better. This is an argument that RL and thinking tokens were a genuinely useful technique which I see as counter to the author’s thesis.
I also think a lot of what the author is referring to was more generously arguing against next token prediction (exact match of an answer) rather than the sequence-level rewards in R1.