2 ms·
Demystifying GPT Self-Repair for Code Generation
- famouswaffles 3y agoWhat I thought particularly interesting "....With this evaluation strategy, we find that the effectiveness of self-repair is only seen in GPT-4. We also observe that self-repair is bottlenecked by the feedback stage; using GPT-4 to give feedback on the programs generated by GPT-3.5 and using expert human programmers to give feedback on the programs generated by GPT-4, we unlock significant performance gains."