4 ms·
From what I can tell, this approach appears to combine "make a plan" style prompting with reinforcement learning? That seems like a clever way to induce reason
by kevmo314 1y ago
From what I can tell, this approach appears to combine "make a plan" style prompting with reinforcement learning?
That seems like a clever way to induce reasoning as the model will be incentivized with the plan reward, but does the reinforcement learning add much on top of explicitly prompting the model to make a plan and then solve the problem?
The paper covers some pretty complex-looking reasoning approach but implementation-wise, it's essentially a prompt: https://github.com/LeapLabTHU/Absolute-Zero-Reasoner/blob/master/absolute_zero_reasoner/data_construction/prompts.py#L3 https://github.com/LeapLabTHU/Absolute-Zero-Reasoner/blob/ma...
- coolcase 1y agoRL changes the weights which is a big deal. RL is expensive using HF. This could cut costs alot. You could have models learning different specialities. One could play with Redis and only do that for example.