3 ms·

Why didn't the customer write the whole app themselves with chatgpt?

shzhdbi09gv8ioi 3y ago
They tried to show me what they meant. ChatGPT proceeded to spit out a snippet of rust code, starting with a dependecy outdated by 4 years, proceeeded to mix API from several versions of the dependency and completely ignored most of the request. Customer do not know rust so it looks amazing to them. ChatGPT is a great con-man for the gullible.
- ben_w 3y ago
  > ChatGPT proceeded to spit out a snippet of rust code, starting with a dependecy outdated by 4 years, proceeeded to mix API from several versions of the dependency and completely ignored most of the request. If that's what you meant, I think everyone here, including the people disagreeing with examples (e.g. me), would have agreed. What I mean with my examples is: it can do all the bits. Is it perfect? Nope. Do you still need a human in the loop to understand the failure modes? Yup. That MS paint app you asked for 45 minutes ago? Features are decomposable, so it can do this step by step, so long as you're OK adding one feature at a time instead of trying to do it all in one go — 75% of the results are fully functional and do what you asked for (which isn't always what you wanted, "tool selector" can be the CSS or the widget itself).
  - shzhdbi09gv8ioi 3y ago
    Some people used to write crap code stitching together snippets from stack overflow, now the same people write crap code stitching together what ChatGPT spit out after trained on said stackoverflow clusterfuck of buggy or flat out incorrect solutions. You do you.
    - ben_w 3y ago
      And those people are now your competitors and customers. Worse (for all of us in this industry) sometimes there's a bug or three, but it can generally fix those bugs by you giving the source code (if the source didn't already come from the LLM) and simply describing the issue. Even when the bug is graphical in nature, which is pretty wild for a text based chat engine that can't see (like 3.5 is). And that's without applying my experience of any language or frameworks, e.g. when asking it for solutions in languages I don't have meaningful professional experience in, like JavaScript. When I can apply my experience, I cringe at the choices it comes up with, and find I want to use it as a rough guide rather than a complete answer. But you know who doesn't care about cringy code? Everyone who isn't a developer. Even QA only cares if it passes the tests.
      - shzhdbi09gv8ioi 3y ago
        > And those people are now your competitors and customers. For now, yes. > When I can apply my experience, I cringe at the choices it comes up with, and find I want to use it as a rough guide rather than a complete answer. But you know who doesn't care about cringy code? Everyone who isn't a developer. Even QA only cares if it passes the tests. This is a race to the bottom, surely you must understand that? I expect some of the biggest tech companies to start limiting developer use of LLM:s soon due to the monumental technical debt they are creating. More context: https://visualstudiomagazine.com/articles/2024/01/25/copilot-research.aspx https://visualstudiomagazine.com/articles/2024/01/25/copilot...

They tried to show me what they meant. ChatGPT proceeded to spit out a snippet of rust code, starting with a dependecy outdated by 4 years, proceeeded to mix API from several versions of the dependency and completely ignored most of the request. Customer do not know rust so it looks amazing to them. ChatGPT is a great con-man for the gullible.

ben_w 3y ago
> ChatGPT proceeded to spit out a snippet of rust code, starting with a dependecy outdated by 4 years, proceeeded to mix API from several versions of the dependency and completely ignored most of the request. If that's what you meant, I think everyone here, including the people disagreeing with examples (e.g. me), would have agreed. What I mean with my examples is: it can do all the bits. Is it perfect? Nope. Do you still need a human in the loop to understand the failure modes? Yup. That MS paint app you asked for 45 minutes ago? Features are decomposable, so it can do this step by step, so long as you're OK adding one feature at a time instead of trying to do it all in one go — 75% of the results are fully functional and do what you asked for (which isn't always what you wanted, "tool selector" can be the CSS or the widget itself).
- shzhdbi09gv8ioi 3y ago
  Some people used to write crap code stitching together snippets from stack overflow, now the same people write crap code stitching together what ChatGPT spit out after trained on said stackoverflow clusterfuck of buggy or flat out incorrect solutions. You do you.
  - ben_w 3y ago
    And those people are now your competitors and customers. Worse (for all of us in this industry) sometimes there's a bug or three, but it can generally fix those bugs by you giving the source code (if the source didn't already come from the LLM) and simply describing the issue. Even when the bug is graphical in nature, which is pretty wild for a text based chat engine that can't see (like 3.5 is). And that's without applying my experience of any language or frameworks, e.g. when asking it for solutions in languages I don't have meaningful professional experience in, like JavaScript. When I can apply my experience, I cringe at the choices it comes up with, and find I want to use it as a rough guide rather than a complete answer. But you know who doesn't care about cringy code? Everyone who isn't a developer. Even QA only cares if it passes the tests.
    - shzhdbi09gv8ioi 3y ago
      > And those people are now your competitors and customers. For now, yes. > When I can apply my experience, I cringe at the choices it comes up with, and find I want to use it as a rough guide rather than a complete answer. But you know who doesn't care about cringy code? Everyone who isn't a developer. Even QA only cares if it passes the tests. This is a race to the bottom, surely you must understand that? I expect some of the biggest tech companies to start limiting developer use of LLM:s soon due to the monumental technical debt they are creating. More context: https://visualstudiomagazine.com/articles/2024/01/25/copilot-research.aspx https://visualstudiomagazine.com/articles/2024/01/25/copilot...