4 ms·
I wouldn't go that far, but I agree, my reaction to reading the details was to go "huh?" From the title, my best guess was they applied some kind of RL/GRPO to
by andy_xor_andrew 2y ago
I wouldn't go that far, but I agree, my reaction to reading the details was to go "huh?"
From the title, my best guess was they applied some kind of RL/GRPO to an existing model.
But... they took an existing model that had already undergone SFT for reasoning... and then used it to generate data to SFT the exact same model... nothing wrong with that, but it doesn't seem to warrant the title they chose.