2 ms·
No, you are wrong, and anyone that was an early adopter will tell you. At the start there were many Python coding tasks it completed flawlessly one shot, that a
by PeterStuer 2y ago
No, you are wrong, and anyone that was an early adopter will tell you. At the start there were many Python coding tasks it completed flawlessly one shot, that all later iterations needed 5 takes for if they managed to get it at all. And that was using the early 3 series ChatGPT, which they rapidly nerfed into the ground.While the current GPT-4 model feels better in some other less quantifiable ways, Python coding hasn't recovered.
- whbrown 2y agoThere are even some benchmarks which have caught 'lazy coding' regressions with their latest models[1]. I recall my best experience with their models was last year with an early version of the advanced data analysis feature where it would write a script, write tests for it, run the tests, update the code and/or tests, and re-run them. Presumably that was too expensive, and now it feels like pulling teeth to get the same result. [1] https://aider.chat/2024/04/09/gpt-4-turbo.html https://aider.chat/2024/04/09/gpt-4-turbo.html