4 ms·
I’ve yet to find any LLM that adds value instead of noise. Even the boilerplate you’d hope it could knock out easily is often subtly wrong or outdated.
by wkirby 2y ago
I’ve yet to find any LLM that adds value instead of noise. Even the boilerplate you’d hope it could knock out easily is often subtly wrong or outdated.
- pawelduda 2y agoI once spent an hour on a back and forth conversation with cursor on a boilerplate for a tedious task (I provided a working example). Then the next 2 hours fixing it because of sheer amount of subtle bugs and misplaced values. Maybe 1 out of 10 chats was actually time-saving
- andix 2y agoExactly my experience. Fails on the most basic tasks by introducing subtle bugs. It feels like you're passing tasks to that one junior developer that copy&pastes something from stack overflow instead of solving the problem.
- simonbarker87 2y agoI find that if I explain what I want and if I were speaking to a first day on the job junior then it produces code like that of a mid career dev. As always, the requirements planning and communication is the hardest part of coding.
- andix 2y agoIf you exactly know what you need and describe it like that, sure the LLM can make code out of words. This is very different to my workflow though. Most of the time I don’t really know how the code will look like in the end, it’s a process of trial and error until I have a good solution. I know what to do on a high level, but often I need to read a lot of documentation to find the correct apis and so on.
- jitl 2y agoCursor’s model of select text -> cmd+k -> type instructions -> enter makes it quite versatile and useful for lower level transformations that I’m previously use vim regex find/replace to do. It’s also great for pretty formatting table layouts strings and such; kind of stylistic changes that not even regex helps with. Those use cases it gets right all the time, but they aren’t worth doing if it involves several steps copy-pasting code from your editor to the LLM app/page, so that’s why Cursor really shines.
- wkirby 2y agoI just can't bring myself to expend the resources that a modern LLM requires for something 10% better than the LSP refactor commands.
- jitl 2y agoI think this task could easily be handled by an on device quantized model, I’m sure these companies will start thinking about their costs, right? (Maybe not though)