3 ms·
Not just RLHF but also RLVR, and isn't that the litter lesson though? My sense of the Sutton Dwarkesh interview was that he was calling out that he didn't mean
by snthpy 3mo ago
Not just RLHF but also RLVR, and isn't that the litter lesson though?
My sense of the Sutton Dwarkesh interview was that he was calling out that he didn't mean just longer datasets, but rather learning through exploration and that's exactly RL.
- andai 3mo agoThey just need more contact with reality. That's what RL is right? Contact with narrow subsets of reality.