4 ms·
It'll be really interesting when they run RL training on the harness self-improvement loop. I've tried using LLMs for harness engineering, but it often creates
by supermdguy 2mo ago
It'll be really interesting when they run RL training on the harness self-improvement loop. I've tried using LLMs for harness engineering, but it often creates too much bloat that weighs things down in the end. Guessing it's just not something the models are tuned to do by default.
Curious if anyone's tried using RL for harness engineering? I think we're still pretty far away from the optimal harness, especially when it comes to long-context memory management.
- fizx 2mo agoWhat policy would you use?
- astrobiased 2mo agoNot RL. SFT.
- supermdguy 2mo agoInteresting, what did you use for the data? And do you have a write-up anywhere?
- astrobiased 2mo agoYes, used bert model with decent results.