4 ms·

I've noticed that after using copilot on a code base for a while, you can effectively prompt the AI just by creating a descriptive comment. // This function en

I've noticed that after using copilot on a code base for a while, you can effectively prompt the AI just by creating a descriptive comment. // This function ends the call by sending a disconnection message to all connected peers Bam, copilot will recommend at least the first line, with subsequent lines usually being pretty good, and more and more frequently, it will recommend the whole function. I still use GPT-4 a lot, especially for troubleshooting errors, but I'm always pleasantly surprised at how good copilot can be.

armchairhacker 3y ago
Copilot is a game-changer and very underrated IMO. GPT4 is smart but not really used in production yet. Copilot is reportedly generating 50% of new code and I can't imagine going without it.
- smashface 3y ago
  Where do you get that 50% number? Do you mean 50% of all new code in the industry? That seems beyond extremely unlikely.
  - fnordpiglet 3y ago
    (I read it as 50% of their code)
  - deleted 3y ago
    [deleted]
  - moyix 3y ago
    The number is 40%, and it's 40% of code written by Copilot users. It's also just for Python: > In files where it’s enabled, nearly 40% of code is being written by GitHub Copilot in popular coding languages, like Python—and we expect that to increase. https://github.blog/2022-06-21-github-copilot-is-generally-available-to-all-developers/ https://github.blog/2022-06-21-github-copilot-is-generally-a...
    - iudqnolq 3y ago
      I wonder if this properly counts cases where copilot writes a bunch of code and then I delete it all and rewrite it manually.
      - moyix 3y ago
        From what I remember they check in at a few intervals after the suggestion is made and use string matching to check how much of the Copilot-written code remains.
    - Nifty3929 3y ago
      It's all about the denominator!
  - jvanderbot 3y ago
    There was some discussion by the copilot team that x% of new code in enabled IDEs was generated by copilot. It varies, but here's one post with x=46 from last month. So, very close to half. https://github.blog/2023-02-14-github-copilot-for-business-is-now-available/ https://github.blog/2023-02-14-github-copilot-for-business-i...
  - 2devnull 3y ago
    Measuring output by LOC is not a very useful metric. The sort of code that’s most suited to ai is closer to data than code.
- jvanderbot 3y ago
  For my side projects, copilot easily generates 80% of the code. It snoops around the local filesystem and picks up my naming schemes and style to help recommend better. It makes me so much more productive. For work projects, I tried it on some throwaway work because we're still not allowed to use it for IP reasons, but it is very good at finding small utility functions to help with DRY, and can help with step by step work, but can't generate helpful code quite as easily since some of our API and codebase just doesn't follow its own norms or conventions, and it seems to me that copilot makes a lot of guesses based on its detected conventions.
  - iudqnolq 3y ago
    > It snoops around the local filesystem and picks up my naming schemes and style to help recommend better. Are you sure about this? It doesn't seem to work on my machine. I think it will infer things that might be in other modules, but only based on the name. I'm basing this on the fact it assumes my code has an API shape that's popular but that I don't write (eg free functions vs methods).
    - armchairhacker 3y ago
      It looks at your recently-viewed files in your IDE. I don't think it looks at anything outside your open workspace but maybe...
- Keyframe 3y ago
  I would really love to see that. So far, all I've seen is cookie cutter code to reduce a bit of typing time. Everything else was more or less hot garbage that just stood in the way of typing. Maybe in a few iterations or years. So far, personally, I haven't seen anything useful. Not saying there isn't anything, just that I haven't seen any use and code offered by it stank. Is there a demo of someone using it to showcase this game-changing power?
  - SamPatt 3y ago
    It surprises me to hear this. Have you used it as I described by writing a descriptive comment first then waiting to see its response? I only noticed it getting good at this after I was somewhat far along on a project, so I assume it requires an overall knowledge of what you're trying to do first.
  - armchairhacker 3y ago
    Copilot only writes boilerplate, it can't really handle anything non-trivial. But I write a lot of boilerplate, even using abstraction and in decent programming languages. A surprising amount of code is just boilerplate, even just keywords and punctuation; and there's a lot of small, similar code snippets that you could abstract, but it would actually produce more code and/or make your code harder to understand, so it isn't worth the effort. Plus, tests and documentation (Copilot doubles as a good sentence/"idea" completer when writing).

armchairhacker 3y ago

Copilot is a game-changer and very underrated IMO. GPT4 is smart but not really used in production yet. Copilot is reportedly generating 50% of new code and I can't imagine going without it.

smashface 3y ago
Where do you get that 50% number? Do you mean 50% of all new code in the industry? That seems beyond extremely unlikely.
- fnordpiglet 3y ago
  (I read it as 50% of their code)
- deleted 3y ago
  [deleted]
- moyix 3y ago
  The number is 40%, and it's 40% of code written by Copilot users. It's also just for Python: > In files where it’s enabled, nearly 40% of code is being written by GitHub Copilot in popular coding languages, like Python—and we expect that to increase. https://github.blog/2022-06-21-github-copilot-is-generally-available-to-all-developers/ https://github.blog/2022-06-21-github-copilot-is-generally-a...
  - iudqnolq 3y ago
    I wonder if this properly counts cases where copilot writes a bunch of code and then I delete it all and rewrite it manually.
    - moyix 3y ago
      From what I remember they check in at a few intervals after the suggestion is made and use string matching to check how much of the Copilot-written code remains.
  - Nifty3929 3y ago
    It's all about the denominator!
- jvanderbot 3y ago
  There was some discussion by the copilot team that x% of new code in enabled IDEs was generated by copilot. It varies, but here's one post with x=46 from last month. So, very close to half. https://github.blog/2023-02-14-github-copilot-for-business-is-now-available/ https://github.blog/2023-02-14-github-copilot-for-business-i...
- 2devnull 3y ago
  Measuring output by LOC is not a very useful metric. The sort of code that’s most suited to ai is closer to data than code.
jvanderbot 3y ago
For my side projects, copilot easily generates 80% of the code. It snoops around the local filesystem and picks up my naming schemes and style to help recommend better. It makes me so much more productive. For work projects, I tried it on some throwaway work because we're still not allowed to use it for IP reasons, but it is very good at finding small utility functions to help with DRY, and can help with step by step work, but can't generate helpful code quite as easily since some of our API and codebase just doesn't follow its own norms or conventions, and it seems to me that copilot makes a lot of guesses based on its detected conventions.
- iudqnolq 3y ago
  > It snoops around the local filesystem and picks up my naming schemes and style to help recommend better. Are you sure about this? It doesn't seem to work on my machine. I think it will infer things that might be in other modules, but only based on the name. I'm basing this on the fact it assumes my code has an API shape that's popular but that I don't write (eg free functions vs methods).
  - armchairhacker 3y ago
    It looks at your recently-viewed files in your IDE. I don't think it looks at anything outside your open workspace but maybe...
Keyframe 3y ago
I would really love to see that. So far, all I've seen is cookie cutter code to reduce a bit of typing time. Everything else was more or less hot garbage that just stood in the way of typing. Maybe in a few iterations or years. So far, personally, I haven't seen anything useful. Not saying there isn't anything, just that I haven't seen any use and code offered by it stank. Is there a demo of someone using it to showcase this game-changing power?
- SamPatt 3y ago
  It surprises me to hear this. Have you used it as I described by writing a descriptive comment first then waiting to see its response? I only noticed it getting good at this after I was somewhat far along on a project, so I assume it requires an overall knowledge of what you're trying to do first.
- armchairhacker 3y ago
  Copilot only writes boilerplate, it can't really handle anything non-trivial. But I write a lot of boilerplate, even using abstraction and in decent programming languages. A surprising amount of code is just boilerplate, even just keywords and punctuation; and there's a lot of small, similar code snippets that you could abstract, but it would actually produce more code and/or make your code harder to understand, so it isn't worth the effort. Plus, tests and documentation (Copilot doubles as a good sentence/"idea" completer when writing).