5 ms·
> And sometimes it changed the existing code base to make its new code "pass", when it actually should fix its own code instead. I haven’t tried MiniMax, but G
by amluto 9mo ago
> And sometimes it changed the existing code base to make its new code "pass", when it actually should fix its own code instead.
I haven’t tried MiniMax, but GPT-5.2-Codex has this problem. Yesterday I watched it observe a Python type error (variable declared with explicit incorrect type — fix was trivial), and it added a cast. (“cast” is Python speak for “override typing for this expression”.) I told it to fix it for real and not use cast. So it started sprinkling Any around the program (“Any” is awful Python speak for “don’t even try to understand this value and don’t warn either”).
- kimixa 9mo agoEven Claude opus 4.6 is pretty willing to start tearing apart my tests or special-case test values if it doesn't find a solution quickly (and in c++/rust land a good proportion of its "patience" seems to be taken up just getting things that compile)
- amluto 9mo agoI’ve found that GPT-5.2 is shockingly good at producing code that compiles, despite also being shockingly good at not even trying to compiling it and instead asking me whether I want it to compile the code.
- whattheheckheck 9mo agoOr it uses type ignore comments