4 ms·

> I feel like I'm taking crazy pills when I read about others' experiences. Surely I am not alone? You're not alone :-) I asked a very similar question about a

by fovc 2y ago

> I feel like I'm taking crazy pills when I read about others' experiences. Surely I am not alone? You're not alone :-) I asked a very similar question about a month ago: https://news.ycombinator.com/item?id=42552653 https://news.ycombinator.com/item?id=42552653 and have continued researching since. My takeaway was that autocomplete, boiler plate, and one-off scripts are the main use cases. To use an analogy, I think the code assistants are more like an upgrade from handsaw to power tools and less like hiring a carpenter. (Which is not what the hype engine will claim). For me, only the one-off script (write-only code) use-case is useful. I've had the best results on this with Claude. Emacs abbrevs/snippets (+ choice of language) virtually eliminate the boiler plate problem, so I don't have a use for assistants there. For autocomplete, I find that LSP completion engines provide 95% of the value for 1% of the latency. Physically typing the code is a small % of my time/energy, so the value is more about getting the right names, argument order, and other fiddly details I may not remember exactly. But I find, that LSP-powered autocomplete and tooltips largely solve those challenges.

barrell 2y ago
I think you make a very good point about your existing devenv. I recently turned off GitHub copilot after maybe 2 years of use — I didn’t realize how often I was using its completions over LSPs. Quality of Life went up massively. LSPs and nvim-cmp have come a long way (although one of these days I’ll try blink.cmp)
sdesol 2y ago
> like an upgrade from handsaw to power tools and less like hiring a carpenter. (Which is not what the hype engine will claim). I 100% agree with the not hiring a carpenter part but we need a better way to describe the improvement over just a handsaw. If you have domain knowledge, it can become an incredible design aid/partner. Here is a real world example as to how it is changing things for me. I have a TreeTable component which I built 100% with LLM and when I need to update it, I just follow the instructions in this chat: http://beta.gitsense.com/?chat=dd997ccd-5b37-4591-9200-b975f274450c http://beta.gitsense.com/?chat=dd997ccd-5b37-4591-9200-b975f... Right now, I am thinking about adding folders to organize chats, and here is the chat with DeepSeek for that feature: http://beta.gitsense.com/?chat=3a94ce40-86f2-4e68-b5d7-88d337bd11ba http://beta.gitsense.com/?chat=3a94ce40-86f2-4e68-b5d7-88d33... I'm thoroughly impressed as it suggested data structures and more for me to think about. And here I am asking it to review what was discussed to make the information easier to understand. http://beta.gitsense.com/?chat=8c6bf5db-49a7-4511-990c-5e6ad3a41955 http://beta.gitsense.com/?chat=8c6bf5db-49a7-4511-990c-5e6ad... All of this cost me less than a penny. I'm still waiting for my Anthropic API limit to reset and I'm going to ask Sonnet for feedback as well, and I figure that will cost me 5 cents. I fully understand the not hiring a carpenter part, but I think what LLMs bring to the table is SO MUCH more than an upgrade to a power tool. If you know what you need and can clearly articulate it well enough, there really is no limit to what you can build with proper instructions, provided the solution is in its training data and you have a good enough BS detector.
- strogonoff 2y ago
  > If you know what you need and can clearly articulate it well enough, there really is no limit to what you can build with proper instructions, provided the solution is in its training data and you have a good enough BS detector. In other words: you must already know how to do what you are asking the LLM to do. In other words: it may make sense if typing speed is your bottleneck and you are dealing with repetitive tasks that have well been solved many times (i.e., you want an advanced autocomplete). This basically makes it useless for me. Typing speed is not a bottleneck, I automate or abstract away repetition, and I seek novel tasks that have not yet been well solved—or I just reuse those existing solutions (maybe even contributing to respective OSS projects). The cases where something new is needed in areas that I don’t know well it completely failed me. NB: I never actually used it myself, I only gave into a suggestion by a friend (whom LLM reportedly helps) to use his LLM wrangling skills in a thorny case.
  - sdesol 2y ago
    > In other words: you must already know how to do what you are asking the LLM to do. Those that will benefit the most will be senior developers. They might not know the exact problem or language, but they should know enough to guide the LLM. > In other words: it may make sense if typing speed is your bottleneck and you are dealing with repetitive tasks that have well been solved many times (i.e., you want an advanced autocomplete). I definitely use a LLM as a typist and I love it. I've come to a point now where I mentally ask myself, "Will it take more time to do it myself or to explain it?" Another factor is cost, as you can rack up a bill pretty quickly with Claude Sonnet if you ask it to generate a lot of code. But honestly, what I love about integrating LLM into my workflow is, I'm better able to capture and summarize my thought process. I've also found LLMs can better articulate my thoughts most of the time. If you know how to prompt a LLM, it almost feels like you are working with a knowledgeable colleague. > I never actually used it myself, I only gave into a suggestion by a friend (whom LLM reportedly helps) to use his LLM wrangling skills in a thorny case. LLMs are definitely not for everyone, but I personally cannot see myself coding without LLMs now. Just asking for variable name suggestions is pretty useful. Or describing something vague and having it properly articulate my thoughts is amazing. I think we like to believe what we do is rather unique, but I think a lot of things that we need to do have already been done. Whether it is in the training data is another thing, though.

by fovc 2y ago

barrell 2y ago

I think you make a very good point about your existing devenv. I recently turned off GitHub copilot after maybe 2 years of use — I didn’t realize how often I was using its completions over LSPs. Quality of Life went up massively. LSPs and nvim-cmp have come a long way (although one of these days I’ll try blink.cmp)

sdesol 2y ago

> like an upgrade from handsaw to power tools and less like hiring a carpenter. (Which is not what the hype engine will claim). I 100% agree with the not hiring a carpenter part but we need a better way to describe the improvement over just a handsaw. If you have domain knowledge, it can become an incredible design aid/partner. Here is a real world example as to how it is changing things for me. I have a TreeTable component which I built 100% with LLM and when I need to update it, I just follow the instructions in this chat: http://beta.gitsense.com/?chat=dd997ccd-5b37-4591-9200-b975f274450c http://beta.gitsense.com/?chat=dd997ccd-5b37-4591-9200-b975f... Right now, I am thinking about adding folders to organize chats, and here is the chat with DeepSeek for that feature: http://beta.gitsense.com/?chat=3a94ce40-86f2-4e68-b5d7-88d337bd11ba http://beta.gitsense.com/?chat=3a94ce40-86f2-4e68-b5d7-88d33... I'm thoroughly impressed as it suggested data structures and more for me to think about. And here I am asking it to review what was discussed to make the information easier to understand. http://beta.gitsense.com/?chat=8c6bf5db-49a7-4511-990c-5e6ad3a41955 http://beta.gitsense.com/?chat=8c6bf5db-49a7-4511-990c-5e6ad... All of this cost me less than a penny. I'm still waiting for my Anthropic API limit to reset and I'm going to ask Sonnet for feedback as well, and I figure that will cost me 5 cents. I fully understand the not hiring a carpenter part, but I think what LLMs bring to the table is SO MUCH more than an upgrade to a power tool. If you know what you need and can clearly articulate it well enough, there really is no limit to what you can build with proper instructions, provided the solution is in its training data and you have a good enough BS detector.

strogonoff 2y ago
> If you know what you need and can clearly articulate it well enough, there really is no limit to what you can build with proper instructions, provided the solution is in its training data and you have a good enough BS detector. In other words: you must already know how to do what you are asking the LLM to do. In other words: it may make sense if typing speed is your bottleneck and you are dealing with repetitive tasks that have well been solved many times (i.e., you want an advanced autocomplete). This basically makes it useless for me. Typing speed is not a bottleneck, I automate or abstract away repetition, and I seek novel tasks that have not yet been well solved—or I just reuse those existing solutions (maybe even contributing to respective OSS projects). The cases where something new is needed in areas that I don’t know well it completely failed me. NB: I never actually used it myself, I only gave into a suggestion by a friend (whom LLM reportedly helps) to use his LLM wrangling skills in a thorny case.
- sdesol 2y ago
  > In other words: you must already know how to do what you are asking the LLM to do. Those that will benefit the most will be senior developers. They might not know the exact problem or language, but they should know enough to guide the LLM. > In other words: it may make sense if typing speed is your bottleneck and you are dealing with repetitive tasks that have well been solved many times (i.e., you want an advanced autocomplete). I definitely use a LLM as a typist and I love it. I've come to a point now where I mentally ask myself, "Will it take more time to do it myself or to explain it?" Another factor is cost, as you can rack up a bill pretty quickly with Claude Sonnet if you ask it to generate a lot of code. But honestly, what I love about integrating LLM into my workflow is, I'm better able to capture and summarize my thought process. I've also found LLMs can better articulate my thoughts most of the time. If you know how to prompt a LLM, it almost feels like you are working with a knowledgeable colleague. > I never actually used it myself, I only gave into a suggestion by a friend (whom LLM reportedly helps) to use his LLM wrangling skills in a thorny case. LLMs are definitely not for everyone, but I personally cannot see myself coding without LLMs now. Just asking for variable name suggestions is pretty useful. Or describing something vague and having it properly articulate my thoughts is amazing. I think we like to believe what we do is rather unique, but I think a lot of things that we need to do have already been done. Whether it is in the training data is another thing, though.