2 ms·
i mean they have a verifier, so can't they even get to 90% just by random generation by the net and testing against verifier until it's numerically correct? I t
by Davidzheng 2y ago
i mean they have a verifier, so can't they even get to 90% just by random generation by the net and testing against verifier until it's numerically correct? I think the end solve rate is less important and the generality of approach is maybe more important
- vessenes 2y agoNo, they specifically test for this (the "RL" case). They most particularly can not do this with random generation, which is very interesting.
- Davidzheng 2y agobut i mean it depends on how many attempts you let it generate. the right comparison is to use the test time rl compute to just do generation and compare success rates. (if you gen for long enough you eventually will hit the answer by chance)