3 ms·
> the harness has almost equal, if not more weight than the model itself This feels like a horrible failing of the models to generalize, then - both basic and
by KronisLV 2mo ago
> the harness has almost equal, if not more weight than the model itself
This feels like a horrible failing of the models to generalize, then - both basic and intermediate tasks should be possible to do with Claude Code, OpenCode, Pi, ZCode, Kimi Code, Dirac and tbh any other mainstream or even slightly niche harness. Not doubting the claim itself, there's a reason why good benchmarks include the harness.
- dominotw 2mo agoi think thats BS that harness has equal weight. most of intellegice is still coming from training data not from RL. so how is 'coevolved harness' equal weight.
- disgruntledphd2 2mo ago> most of intellegice is still coming from training data not from RL. For coding specifically, I'm not sure this is still true. Given the heavy use of RL to improve coding performance, I'd expect the harness to be important as it defines what tools the model is rewarded for using.
- dominotw 2mo agoi belive they looked at the traces and they were still legible ( RL traces should be gibberish)