4 ms·
GPT can't even tell what its done or give what it knows it should. It's endless, "Apologies, here is what you actually asked for ..." and again it isn't.
by QuantumGood 2y ago
GPT can't even tell what its done or give what it knows it should. It's endless, "Apologies, here is what you actually asked for ..." and again it isn't.
- MortyWaves 2y agoThis was my primary reason for using Claude. Absolutely useless experience with chatgpt oftentimes. I’ve mainly been using LLMs to help maintain a ridiculously poorly made technical debt dumpster fire, and Claude has been really helpful here mainly with repetitive code.
- therein 2y agoYeah ChatGPT is truly the worst. Claude has been consistently much better. Grok 3 is surprising me every day.
- derefr 2y agoI would love an AI coding assistant that doesn't respond until it's gone out and tested its answer in a sandbox to confirm it actually compiles.
- AprilisKalends 2y agoI personally haven't figured out why there isn't a tool that just loops the AI severals times on a task by compiling, feeding in the errors adjusting and repeating and then letting the user review the result be in a success or failure by exceed the loop limits.
- ta988 2y agoThey exist in various forms...
- throawayonthe 2y ago[dead]
- staticautomatic 2y agoClaude has a tendency to overcomplicate bug fixes. If you put it on loop it would probably build a custom ERP platform.
- anonzzzies 2y agoThe LLMs want to please, they can infinitely keep making 'important' changes; changing variable names without changing anything else, adding/removing comments, adding removing print statements, moving a function somewhere in the code (usually by first duplicating it) and fixing perfectly fine code with 'let me see if everything is really working' (it was and now it's broken again).
- derefr 2y ago"Wanting to please" is just fine-tuned implicit prompt stuff, though. You can tell the LLM that it's roleplaying as a senior engineer, and should consider you, the human to be a junior engineer it works with, who is asking it for advice. You can just leave it at that (often works, if the AI knows enough about how software is produced); or you can describe particular traits of senior engineers — e.g. "wants code that works" and "knows when to say the code is good enough and that the junior is now wasting time by fiddling with it."
- deleted 2y ago[deleted]
- v-yanakiev 2y agohttps://syntix.pro https://syntix.pro automatically executes and verifies the code it generates. Disclaimer: I made it.
- mycall 2y agoDevin does that
- anonzzzies 2y agoWasn't Devin a scam? Honest question; Google is not very clear about it but some people said it was a scam/money grab. You are saying it works?