4 ms·

I'm confident you have not used Cursor Composer + Claude 3.5 Sonnet. I'd say the level of bugs is no higher than that of a typical engineer - maybe even lower.

• hobs 2y ago
  There's no LLM for which that is true or we'd all be fired.
  • joshuacc 2y ago
    In my experience it is true, but only for relatively small pieces of a system at the time. LLMs have to be orchestrated by a knowledgeable human operator to build a complete system any larger than a small library.
  • dagw 2y ago
    If all you bring to the table is the ability to reimplement simple web apps to spec, then sooner or later you probably will be fired.
  • ben_w 2y ago
    In the long term, sure. Short term, when that happens, we're going to be on Wile E. Cyote physics and keep up until we look down and notice the absence of ground.
• threeseed 2y ago
  It's only as good as its training data. Step outside of building basic web/CRUD apps and its accuracy drops off substantially. Also almost every library it uses is old and insecure.
  • whatshisface 2y ago
    That last point represents the biggest problem this technology will leave us with. Nobody's going to train LLMs on new libraries or frameworks when writing original code takes an order of magnitude longer than generating code for the 2023 stack.
    • Workaccount2 2y ago
      With LLM's like gemini, which have massive context windows, you can just drop the full documentation for anything in the context window. It dramatically improves output.
    • SubiculumCode 2y ago
      I use phind which does searches to provide additional context
  • mewpmewp2 2y ago
    Yet most work seems to be CRUD related and most SaaS businesses starting up just really need those things mainly.
• apwell23 2y ago
  I am confident you didn't understand my comment. I didn't say anything about "level of bugs".