4 ms·

> If you know what you need to do and how to do it Having used it for the last week or so to help me translate Python -> Rust, I'd say GPT4 is on par with even

> If you know what you need to do and how to do it Having used it for the last week or so to help me translate Python -> Rust, I'd say GPT4 is on par with even senior engineers for anything built in. The key areas it falls down on are anything involving org/repo knowledge or open source where things can be out of date. There's a few teams working on intelligent org/repo/opensource context fetching, which I think will lead to another 10X improvement.

logankeenan 4y ago
> I'd say GPT4 is on par with even senior engineers I agree, I avoided saying that in my original comment to avoid nit picking. The depth of knowledge is incredible. It’ll just make junior level mistakes while writing senior level code. > The key areas it falls down on are anything involving org/repo knowledge or open source where things can be out of date. With GPT-4, I’ll paste snippets of code after the prompt so it has that context or even documentation of the API I need it to work with. The web client is still limited in the amount of tokens it’ll accept in the prompt, but that is expected to increase at some point
- IanCal 4y ago
  Also the setup described in the post is like pairing with someone that can't run the code and is writing in notepad. More intelligently putting it in a loop & other helpers for it (which we're now seeing worked on more) should massively improve performance.
f0e4c2f7 4y ago
This is also available with chatgpt plugins in alpha, one of the plugins is websearch. It works pretty well in bing which also allows this and is reportedly based on gpt4. Short of that, another thing I've found to work pretty well is pasting in the api docs for the relevant api at the beginning of the prompt and explaining that is the more updated info.
bradgessler 4y ago
This is a use case I could see GPT really excelling—porting libraries from one programming language to another. How awesome would that be? Newish ecosystems like Rust, Crystal, Elixir, etc. could have a larger set of libraries in a shorter amount of time. There’s still a lot of need for a human to be involved, buts it’s not hard to see how this will make individual developers more productive, especially as LLMs mature, plug themselves into interpreters, and become more capable.
- weatherlite 4y ago
  I don't share the enthusaism since it probably means humans won't be looking at code much anymore, at least not as a paid job.
  - reidjs 4y ago
    The goal shouldn’t be to code, but to create useful software.
    - int_19h 4y ago
      The real concern is that code will become too incomprehensible to be debugged by most humans before we solve hallucinations etc (if they even are solvable) leading to bugs.
  - chaxor 4y ago
    I am starting to think of this more in the sense that 'not many people write in assembly anymore' or 'some people write C - sure - but writing in Nim can be a nicer experience and can take care of some of the details for me' and it has been helpful for me to come to terms with the direction things are moving. Granted, this is a big step to higher level "programming" (and those quotes are now bigger than ever) but, as pointed out, these LLMs are even better when you know how to use the linguistic interface like a senior dev rather than a person off the street. Effectively, now devs can now work to make decisions closer to the C-suite by framing the problem and constraints, and spend less time on the frustrating errors while developing.
- 4y ago

logankeenan 4y ago

> I'd say GPT4 is on par with even senior engineers I agree, I avoided saying that in my original comment to avoid nit picking. The depth of knowledge is incredible. It’ll just make junior level mistakes while writing senior level code. > The key areas it falls down on are anything involving org/repo knowledge or open source where things can be out of date. With GPT-4, I’ll paste snippets of code after the prompt so it has that context or even documentation of the API I need it to work with. The web client is still limited in the amount of tokens it’ll accept in the prompt, but that is expected to increase at some point

IanCal 4y ago
Also the setup described in the post is like pairing with someone that can't run the code and is writing in notepad. More intelligently putting it in a loop & other helpers for it (which we're now seeing worked on more) should massively improve performance.

f0e4c2f7 4y ago

This is also available with chatgpt plugins in alpha, one of the plugins is websearch. It works pretty well in bing which also allows this and is reportedly based on gpt4. Short of that, another thing I've found to work pretty well is pasting in the api docs for the relevant api at the beginning of the prompt and explaining that is the more updated info.

bradgessler 4y ago

This is a use case I could see GPT really excelling—porting libraries from one programming language to another. How awesome would that be? Newish ecosystems like Rust, Crystal, Elixir, etc. could have a larger set of libraries in a shorter amount of time. There’s still a lot of need for a human to be involved, buts it’s not hard to see how this will make individual developers more productive, especially as LLMs mature, plug themselves into interpreters, and become more capable.

weatherlite 4y ago
I don't share the enthusaism since it probably means humans won't be looking at code much anymore, at least not as a paid job.
- reidjs 4y ago
  The goal shouldn’t be to code, but to create useful software.
  - int_19h 4y ago
    The real concern is that code will become too incomprehensible to be debugged by most humans before we solve hallucinations etc (if they even are solvable) leading to bugs.
- chaxor 4y ago
  I am starting to think of this more in the sense that 'not many people write in assembly anymore' or 'some people write C - sure - but writing in Nim can be a nicer experience and can take care of some of the details for me' and it has been helpful for me to come to terms with the direction things are moving. Granted, this is a big step to higher level "programming" (and those quotes are now bigger than ever) but, as pointed out, these LLMs are even better when you know how to use the linguistic interface like a senior dev rather than a person off the street. Effectively, now devs can now work to make decisions closer to the C-suite by framing the problem and constraints, and spend less time on the frustrating errors while developing.
4y ago