4 ms·
So far, eqch and every time I used an LLM to help me with something it hallucinated non-existant functions or was incorrect in an important but non-obvious way.
by Akronymus 9mo ago
So far, eqch and every time I used an LLM to help me with something it hallucinated non-existant functions or was incorrect in an important but non-obvious way.
Though, I guess I do treat LLM's as a last resort longshot for when other documentation is failing me.
- naasking 9mo agoKnowing how to use LLMs is a skill. Just winging it without any practice or exploration of how the tool fails can produce poor results.
- b112 9mo ago"You're holding it wrong" 99% of an LLM's usefulness vanishes, if it behaves like an addled old man. "What's that sonny? But you said you wanted that!" "Wait, we did that last week? Sorry let me look at this again" "What? What do you mean, we already did this part?!"
- naasking 9mo agoWrong mental model. Addled old men can't write code 1000x faster than any human.
- b112 9mo agoI'd prefer 1x "wrong stuff" than wrong stuff blasted 1000x. How is that helpful? Further, they can't write code that fast, because you have to spend 1000x explaining it to them.
- naasking 9mo agoExcept it's not 1000x wrong stuff, that's the point. But don't worry, the Amish are welcoming of new luddites!
- oblio 9mo agoWhich LLMs have you tried? Claude Code seems to be decent at not hallucinating, Gemini CLI is more eager. I don't think current LLMs take you all the way but a powerful code generator is a useful think, just assemble guardrails and keep an eye on it.
- Akronymus 9mo agoMostly chatgpt because I see 0 value in paying for any llm, nor do I wish to gice up my data to any llm provider
- oblio 9mo agoThey work better with project context and access to tools, so yeah, the web interface is not their best foot forward. That doesn't mean the agents are amazing, but they can be useful.
- Akronymus 9mo agoA simple "how do I access x in y framework in the intended way" shouldnt require any more context. instead of telling me about z option it keeps hallucinating something that doesnt exist and even says its in the docs when it isnt. Literally just wasting my time
- oblio 9mo agoI was in the same camp until a few months ago. I now think they're valid tools, like compilers. Not in the sense that everyone compares them (compilers made asm development a minuscule niche of development). But in the sense that even today many people don't use compilers or static analysis tools. But that world is slowly shrinking. Same for LLMs, the non LLM world will probably shrink. You might be able to have a long and successful career without touching them for code development. Personally I'd rather check them out since tools are just tools.
- Anamon 9mo agoSpeaking as someone who doesn't really like or do LLM-assisted coding either: at least try Gemini. ChatGPT is the absolute worst you could use. I was quite shocked when I compared the two on the same tasks. Gemini gets decent initial results you can build on. ChatGPT generates 99% absolutely unusable rubbish. The difference is so extreme, it's not even a competition anymore. I now understand why Altman announced "Code Red" at OpenAI. If their tools don't catch up drastically, and fast, they'll be one for the history books soon. Wouldn't be the first time the big, central early mover in a new market suddenly disappears, steamrolled by the later entrants.