What I thought particularly interesting "....With this evaluation strategy, we find that the effectiveness of self-repair is only seen in GPT-4. We also observ

What I thought particularly interesting "....With this evaluation strategy, we find that the effectiveness of self-repair is only seen in GPT-4. We also observe that self-repair is bottlenecked by the feedback stage; using GPT-4 to give feedback on the programs generated by GPT-3.5 and using expert human programmers to give feedback on the programs generated by GPT-4, we unlock significant performance gains."