This underscores the problem with GPT-4 currently. It apparently can't do what any legitimate programmer can do: look at code and simulate operations in their h

This underscores the problem with GPT-4 currently. It apparently can't do what any legitimate programmer can do: look at code and simulate operations in their head. Of course programs need to be run on actual hardware with real program support to find bugs, but they have to first be written and confirmed correct as well as possible, mentally. As it stands now they're doing some kind of fuzzy pattern matching that's kinda-sorta plausible and often completely wrong on inspection. And amusingly (?) if you ask it to try again, it'll come up quite different and also completely wrong code. To be really good at programming these systems need the equivalent of the "understanding" a human programmer has, not just some abstract fuzzy pattern matching.