2 ms·
Beat GPT-4o at Python by searching with 100 dumb LLaMAs
- charles_irl 2y agoOne of the authors, Charles, here. I wrote this up because 1) I've been following work on sampling/inference-time compute scaling and the "Large Language Monkeys" paper (https://arxiv.org/abs/2407.21787 https://arxiv.org/abs/2407.21787) results looked promising and 2) our reproduction was effortless and immediate, which has not been my experience with most research. Happy to answer questions!