I agree in general, though I think you're being too optimistic about GPT4 finding and fixing its mistakes. I haven't been using it much, but the only thing wher

I agree in general, though I think you're being too optimistic about GPT4 finding and fixing its mistakes. I haven't been using it much, but the only thing where it performed flawlessly was translating a simple song into Spanish. At the same time, GPT is a total sycophant and this makes it rather hard to work with. Whenever I give it feedback it agrees with whatever I have said and then proceeds to produce paragraphs of text which include several contradictions of the things we've "agreed" on. I think the "stochastic parrot" idea is too harsh, but it does reflect that GPT is fundamentally incapable of looking at a small block of text, turning it into a set of logical facts, and recognizing if those facts are consistent or not. I think it is something that is possible to build with a refinement of GPT, but I'm not sure it can be done simply with glue code.