4 ms·

Eventually you get to a point where the AI simply doesn’t know how to do something correctly. It can’t fix a certain bug, or implement a feature correctly. At t

by xwdv 4y ago

Eventually you get to a point where the AI simply doesn’t know how to do something correctly. It can’t fix a certain bug, or implement a feature correctly. At this point you are left trying to do more and more prompt crafting… or you can just fix the problem yourself. If you can’t do it yourself, you’re screwed. I wonder if the future will just be software hobbled together with shitty AI code that no one understands, with long loops and deep call stacks and abstractions on top of abstractions, while tech priests take a prompt and pray approach to eventually building something that does kind of what they want. Or to hell with priests! Build some temple where users themselves can come leave prompts for the general AI to hear and maybe put out a fix for some app running on their tablets devices.

tobiasSoftware 4y ago
I don't see programming going away for this reason. Think about it, if you have to carefully describe what you want to do to an AI - you are just writing a program. Only a program is deterministic and will do what you tell it to, whereas an AI may or may not. The future that I see, coding and AI are divided into two camps. The one is what we would call "script kiddies" today - people who don't understand how to write software, but know enough to ask the right questions and bodge what they get together into something that mostly works. The other camp would be programmers who are similar to programmers today, but use AI to write boilerplate for them, as well as replace Stack Overflow.
- antibasilisk 4y ago
  Between GPT-3 and GPT-4 the precision required for prompts was decreased significantly. In theory it should reach the point where a project manager type person would be able to describe what is needed and it would simply do it, the main thing missing from attaining that is that GPT-4 basically never responds to questions with requests for clarification, otherwise, a whole team of developers could be reduced to just one proofreader.
  - xwdv 4y ago
    That’s not very impressive. With very little precision I can throw a few keywords into google and get a full answer and perhaps some code snippets from stack overflow to solve whatever problem I have in the moment. Except you can’t just blindly copy code snippets, you have to read the author’s explanation and perhaps adapt things to your own code sometimes, or reject their solution entirely. GPT-4 can’t do this because it doesn’t actually know what the hell it’s doing, it’s just putting stuff together in a form that is most probably correct based on what it has seen in training data for past examples. I fear for the layman who sees a bunch of AI generated code and think it must be right. Who knows what bugs, security flaws, or performance issues they will run into, that they have no idea how to solve or even to begin asking a prompt for.
    - UncleEntity 4y ago
      > That’s not very impressive. That’s kind of impressive. I usually have zero luck with stack overflow except for super trivial things. Some of the stuff I’ve done has no documentation and I had to find an example (like one other person in the entire history of mankind though this was a good idea) on some random repo on GitHub. Or I’m implementing code from a paper written 30 or 40 years ago and there’s no example code to look at. I could ask on stack overflow but who needs that abuse? Admittedly I just do this to amuse myself and think that having a LLM digest a paper and spit out code is the bee’s knees.
      - ozfive 4y ago
        > Admittedly I just do this to amuse myself and think that having a LLM digest a paper and spit out code is the bee’s knees. This is what I have been doing also. Verification/Implementation of Software Engineering papers will be juicy especially with image ingestion.
    - osigurdson 4y ago
      You must not have used GPT very much based on this response. It is pretty great.
    - 4y ago
- osigurdson 4y ago
  I'm already at the point where I get frustrated when GPT writes some incorrect code - despite it saving me enormous amounts of time. The appetite for productivity seems to be insatiable. I want to be able to create a million lines of code per month by myself.
  - zenlikethat 4y ago
    So relatable! I find myself getting irritated when it gets stuck on something and I have to intervene, yet it helps absolutely shred LOCs in some other cases.
    - tablatom 4y ago
      "If we wish to count lines of code, we should not regard them as lines produced but as lines spent." — Dijkstra
      - osigurdson 4y ago
        I think these days, LOC is a reasonable metric for a peer-reviewed code base. It is unlikely that the lines of code in a given project can be reduced by 10X in a maintainable way. Can we easily reduce the LOC in the Linux kernel or Postgres by 10X for example? It seems unlikely. LOC is a fuzzy proxy for the amount information in a code base. It should never be used for any kind of productivity metric however since that is obviously dumb and easily gameable (win by writing terrible code). Of course most productivity metrics are fall into the dumb/gameable category so lets not use them.
  - tlrobinson 4y ago
    > I want to be able to create a million lines of code per month by myself. That sounds terrible. Who is going to read all that code when you need to understand and modify it? The LLMs, I guess? I'd much rather be able to write 10,000 lines of code that can do what your million lines of code does. Better programming languages, libraries, and other abstractions are what we need.
- hackerlight 4y ago
  The problem is the unfounded assumption that the code will be shitty 10 years from now. You really want to make that bet given the extreme velocity of recent progress? My expectation is that the code will actually be good.
Bjartr 4y ago
> I wonder if the future will just be software hobbled together with shitty AI code that no one understands, with long loops and deep call stacks and abstractions on top of abstractions There's plenty of software out there that fits this description if you just remove "AI" from the statement. There's nothing new about bad codebases. Now it just costs pennies and is written in seconds instead of thousands paid to an outsourcing middleman firm that takes weeks or months to turn it around.
- deleted 4y ago
  [deleted]
- greesil 4y ago
  At least the shitty software might have unit tests
  - osigurdson 4y ago
    GPT can write pretty good unit tests imo.
    - SparkyMcUnicorn 4y ago
      Agreed. It knows what something is supposed to do fairly well.
  - serpix 4y ago
    co-pilot excels in writing tests. It removes so much of the tedium and boilerplate. It seems to understand fixtures once you define one and understands subsequent changes to the boilerplate such as changing usernames, ids, appending items to lists. It is such a massive boost in productivity that those using it are way ahead of those who resist.
    - greesil 4y ago
      That's great. I've done something much similar with other tools. It certainly helps automate the drudgery in writing tests for code that I understand and wrote.
layer8 4y ago
> software hobbled together with shitty AI code that no one understands That’s my fear as well. Software may just get shittier overall (aka “good enough”), and in higher volumes, due to it taking less time to crank out using AI.
- ChatGTP 4y ago
  I think it's going to be the end of libraries, why would people bother with libraries when every service can be churned out in 5 seconds with ChatGPT ? We're going to witness he greatest copy pasta in history and find out how that goes.
  - Meathelix 4y ago
    [dead]
  - zenlikethat 4y ago
    I think it will be a bit of both, why reach for that module when you can just get AI to write the 10% you need so quickly? (Which is actually a net gain I think in many cases, just look at leftpad drama) But the productivity boost from AI will also lead to more libraries available that do useful things in the areas it's not so sharp. They will also start to lean in to AI assisted coding styles too of course. And once we get good tooling to inject in recent data, source code, etc so it can use those as well... gonna be great
    - ChatGTP 4y ago
      I think the end of libraries would be bad, even for LLMs, they're not super intelligence and the more spaghetti code they're asked to work with, the less likely they will be able to perform, because statistically, they will be very hard to grok. It will increasingly have to deal with more and more entropy. Infact, it probably performs so well because of the heavy use of libraries we see today. Also side note: I doubt you're ever going to be able to upload code to an LLM my friend, not a publicly accessible one. It would be quite dangerous? Could you imagine the attacks, the implanting of back doors etc? Don't think so. I'd say scraping the web is probably going to be an increasingly dangerous pursuit for ChatGPT now people are getting to better understand the attack vectors available.
amq 4y ago
Most of the software will be GPT itself.
- thingification 4y ago
  Yes, aren't we under-focusing a bit, right now, on the goals that in the past were achieved by writing code but will in the future be achieved by LLMs themselves (and their replacements)? For example, maybe we write some code now with the goal of helping a customer service person do their job. But we all know that plenty of people are trying to replace customer service people with LLMs, not use LLMs to write tools to help customer service people. I see that the LLM still needs to know what's going on with the customer account, and maybe for a long time that takes the form of conventional APIs. But surely something is going to change here?

by xwdv 4y ago

tobiasSoftware 4y ago

I don't see programming going away for this reason. Think about it, if you have to carefully describe what you want to do to an AI - you are just writing a program. Only a program is deterministic and will do what you tell it to, whereas an AI may or may not. The future that I see, coding and AI are divided into two camps. The one is what we would call "script kiddies" today - people who don't understand how to write software, but know enough to ask the right questions and bodge what they get together into something that mostly works. The other camp would be programmers who are similar to programmers today, but use AI to write boilerplate for them, as well as replace Stack Overflow.

antibasilisk 4y ago
Between GPT-3 and GPT-4 the precision required for prompts was decreased significantly. In theory it should reach the point where a project manager type person would be able to describe what is needed and it would simply do it, the main thing missing from attaining that is that GPT-4 basically never responds to questions with requests for clarification, otherwise, a whole team of developers could be reduced to just one proofreader.
- xwdv 4y ago
  That’s not very impressive. With very little precision I can throw a few keywords into google and get a full answer and perhaps some code snippets from stack overflow to solve whatever problem I have in the moment. Except you can’t just blindly copy code snippets, you have to read the author’s explanation and perhaps adapt things to your own code sometimes, or reject their solution entirely. GPT-4 can’t do this because it doesn’t actually know what the hell it’s doing, it’s just putting stuff together in a form that is most probably correct based on what it has seen in training data for past examples. I fear for the layman who sees a bunch of AI generated code and think it must be right. Who knows what bugs, security flaws, or performance issues they will run into, that they have no idea how to solve or even to begin asking a prompt for.
  - UncleEntity 4y ago
    > That’s not very impressive. That’s kind of impressive. I usually have zero luck with stack overflow except for super trivial things. Some of the stuff I’ve done has no documentation and I had to find an example (like one other person in the entire history of mankind though this was a good idea) on some random repo on GitHub. Or I’m implementing code from a paper written 30 or 40 years ago and there’s no example code to look at. I could ask on stack overflow but who needs that abuse? Admittedly I just do this to amuse myself and think that having a LLM digest a paper and spit out code is the bee’s knees.
    - ozfive 4y ago
      > Admittedly I just do this to amuse myself and think that having a LLM digest a paper and spit out code is the bee’s knees. This is what I have been doing also. Verification/Implementation of Software Engineering papers will be juicy especially with image ingestion.
  - osigurdson 4y ago
    You must not have used GPT very much based on this response. It is pretty great.
  - 4y ago
osigurdson 4y ago
I'm already at the point where I get frustrated when GPT writes some incorrect code - despite it saving me enormous amounts of time. The appetite for productivity seems to be insatiable. I want to be able to create a million lines of code per month by myself.
- zenlikethat 4y ago
  So relatable! I find myself getting irritated when it gets stuck on something and I have to intervene, yet it helps absolutely shred LOCs in some other cases.
  - tablatom 4y ago
    "If we wish to count lines of code, we should not regard them as lines produced but as lines spent." — Dijkstra
    - osigurdson 4y ago
      I think these days, LOC is a reasonable metric for a peer-reviewed code base. It is unlikely that the lines of code in a given project can be reduced by 10X in a maintainable way. Can we easily reduce the LOC in the Linux kernel or Postgres by 10X for example? It seems unlikely. LOC is a fuzzy proxy for the amount information in a code base. It should never be used for any kind of productivity metric however since that is obviously dumb and easily gameable (win by writing terrible code). Of course most productivity metrics are fall into the dumb/gameable category so lets not use them.
- tlrobinson 4y ago
  > I want to be able to create a million lines of code per month by myself. That sounds terrible. Who is going to read all that code when you need to understand and modify it? The LLMs, I guess? I'd much rather be able to write 10,000 lines of code that can do what your million lines of code does. Better programming languages, libraries, and other abstractions are what we need.
hackerlight 4y ago
The problem is the unfounded assumption that the code will be shitty 10 years from now. You really want to make that bet given the extreme velocity of recent progress? My expectation is that the code will actually be good.

Bjartr 4y ago

> I wonder if the future will just be software hobbled together with shitty AI code that no one understands, with long loops and deep call stacks and abstractions on top of abstractions There's plenty of software out there that fits this description if you just remove "AI" from the statement. There's nothing new about bad codebases. Now it just costs pennies and is written in seconds instead of thousands paid to an outsourcing middleman firm that takes weeks or months to turn it around.

deleted 4y ago
[deleted]
greesil 4y ago
At least the shitty software might have unit tests
- osigurdson 4y ago
  GPT can write pretty good unit tests imo.
  - SparkyMcUnicorn 4y ago
    Agreed. It knows what something is supposed to do fairly well.
- serpix 4y ago
  co-pilot excels in writing tests. It removes so much of the tedium and boilerplate. It seems to understand fixtures once you define one and understands subsequent changes to the boilerplate such as changing usernames, ids, appending items to lists. It is such a massive boost in productivity that those using it are way ahead of those who resist.
  - greesil 4y ago
    That's great. I've done something much similar with other tools. It certainly helps automate the drudgery in writing tests for code that I understand and wrote.

layer8 4y ago

> software hobbled together with shitty AI code that no one understands That’s my fear as well. Software may just get shittier overall (aka “good enough”), and in higher volumes, due to it taking less time to crank out using AI.

ChatGTP 4y ago
I think it's going to be the end of libraries, why would people bother with libraries when every service can be churned out in 5 seconds with ChatGPT ? We're going to witness he greatest copy pasta in history and find out how that goes.
- Meathelix 4y ago
  [dead]
- zenlikethat 4y ago
  I think it will be a bit of both, why reach for that module when you can just get AI to write the 10% you need so quickly? (Which is actually a net gain I think in many cases, just look at leftpad drama) But the productivity boost from AI will also lead to more libraries available that do useful things in the areas it's not so sharp. They will also start to lean in to AI assisted coding styles too of course. And once we get good tooling to inject in recent data, source code, etc so it can use those as well... gonna be great
  - ChatGTP 4y ago
    I think the end of libraries would be bad, even for LLMs, they're not super intelligence and the more spaghetti code they're asked to work with, the less likely they will be able to perform, because statistically, they will be very hard to grok. It will increasingly have to deal with more and more entropy. Infact, it probably performs so well because of the heavy use of libraries we see today. Also side note: I doubt you're ever going to be able to upload code to an LLM my friend, not a publicly accessible one. It would be quite dangerous? Could you imagine the attacks, the implanting of back doors etc? Don't think so. I'd say scraping the web is probably going to be an increasingly dangerous pursuit for ChatGPT now people are getting to better understand the attack vectors available.

amq 4y ago

Most of the software will be GPT itself.

thingification 4y ago
Yes, aren't we under-focusing a bit, right now, on the goals that in the past were achieved by writing code but will in the future be achieved by LLMs themselves (and their replacements)? For example, maybe we write some code now with the goal of helping a customer service person do their job. But we all know that plenty of people are trying to replace customer service people with LLMs, not use LLMs to write tools to help customer service people. I see that the LLM still needs to know what's going on with the customer account, and maybe for a long time that takes the form of conventional APIs. But surely something is going to change here?