https://arxiv.org/abs/2408.15240 https://arxiv.org/abs/2408.15240 > We demonstrate that when using Gemma-based verifiers on algorithmic and grade-school math r

https://arxiv.org/abs/2408.15240 https://arxiv.org/abs/2408.15240 > We demonstrate that when using Gemma-based verifiers on algorithmic and grade-school math reasoning tasks, GenRM outperforms discriminative verifiers and LLM-as-a-Judge, showing a 16-64% improvement in the percentage of problems solved with Best-of-N. Furthermore, we show that GenRM scales favorably across dataset size, model capacity, and inference-time compute.