7 ms·

Unless you never copy/paste from stackoverflow, this argument is kinda moot. Copilot/kite/etc don't intend to replace your brain, it's a shortcur for googling.

• tyingq 5y ago
  Stackoverflow at least has the benefit of whatever comments might be around it. As far as I can tell, the copilot suggestion doesn't have any way to rate it, make a comment, flag it, etc.
  • jfoster 5y ago
    I think they kind of do. On the Telemetry section of the Copilot site, they mention that they relay whether a suggestion was accepted or rejected. I wonder, how much better could Github Copilot become by also looking that the modifications that are subsequently made to the accepted suggestions? Obviously this would go quite a bit further in terms of telemetry, and may become an issue. They would essentially be training based on non-public code at that point.
    • tyingq 5y ago
      I guess that's a start, but I think comments, flagging, would have value. There's lots of reasons you might not accept something.
    • ffhhj 5y ago
      > On the Telemetry section of the Copilot site, they mention that they relay whether a suggestion was accepted or rejected. That will make it the target of a collaborative bias attack.
      • naniwaduni 5y ago
        Wait, are we sure it'd need to be collaborative?
  • ratherbefuddled 5y ago
    I'm guessing but surely it reads the code you end up with and uses that to train?
    • e_proxus 5y ago
      So it will be self-reinforced to get worse and rot over time? Since surely all code that used Copilot will be slightly worse than code without (extrapolated on the assumption that Copilot is wrong some of the time).
  • squeaky-clean 5y ago
    Agreed. How many times have you seen the "accepted" answer on a Stackoverflow be suboptimal if not outright wrong, and a much better answer is lower down the page. For me it feels like 50% of the time or more.
• vincnetas 5y ago
  Let's agree that copy/paste from stack overflow is bad, and don't use "but people are already doing this" to justify copilot approach.
  • YetAnotherNick 5y ago
    > don't use "but people are already doing this" to justify copilot approach. Why not? Most of the software is not built by checking the formal verification of specification but by looking into the code and having reasonable understanding that it works. Also there will be errors in the code whether we use copilot or not. Personally if I don't have an option to do a build and run and look into the output, I am reasonably sure that there is at least one bug in something like every 50 lines.
  • BiteCode_dev 5y ago
    I don't agree. I use it all the time. I just don't do it blindly.
    • addicted 5y ago
      I'll add that with SO it's always helpful to read a few answers below the accepted ones. There's always almost some nuance that the accepted answer might be lacking or you should know about that is mentioned.
    • midev 5y ago
      Sometimes I do it blindly too! I don't always care about the "how". Sometimes I'm just looking for a single line to convert a data type, or a bash command to do something. Not interested in learning all the arguments to various bash tools. I just want to delete some files and move on.
  • tailspin2019 5y ago
    > Let's agree that copy/paste from stack overflow is bad I think context is important. It's not inherently bad. If you are inexperienced or don't know what the code/command is doing then yes that's not ideal. But competent developers using Stack Overflow (and all other external memory devices) appropriately to aid their workflow is perfectly valid. I rarely copy/paste verbatim from Stack Overflow (apart from perhaps bash commands where the answer is literally the exact command I need - and in that case, why would I not use it?). But I do copy/paste, as long as I understand the code, and then adjust it accordingly. In my experience of coaching junior devs. The number one skill I've had to train them in, above all else, is the ability to efficiently search for and find answers to their questions/unknowns quickly. (As well as digest those answers and incorporate the knowledge into their understanding - not just blind copy/paste). I'd go as far as to say that If you are a developer in 2021 and not constantly looking up things for reference (whether to jog your memory or to quickly learn new concepts) then you're either a genius with a photographic memory, working in a very constrained domain that isn't stretching you or you're just plain doing it wrong. :-)
• dariusj18 5y ago
  I'm not sure I've ever copied code from StackOverflow, though I do use it for inspiration.
  • BiteCode_dev 5y ago
    Not even a command line ?
    • dariusj18 5y ago
      Oh no, definitely not. If I don't understand what it is doing then I don't put in in my command line. That's a recipe for disaster.
      • BiteCode_dev 5y ago
        why would you not understand it ? it seems unrelated.
      • AlexAndScripts 5y ago
        What if you now understand what it's doing (jogged your memory) and its a long command?
        • dariusj18 5y ago
          Very rarely does a command line example map one to one with what I want to accomplish anyway. But also, I can't think of any "long" commands that I would need.
        • marcosdumay 5y ago
          Then you take the lessons you need from the line and encode them in a properly formatted script. A long command is almost never a good answer.
    • corobo 5y ago
      Type it out anyway, copy paste security risks or not, it helps you remember how to do it in future
• lucideer 5y ago
  Copy/paste from stackoverflow is a great analogy: Copilot is making something that already has a huge negative* impact on code quality more optimised and easier to do as part of your daily coding flow. * Just to clarify, I'm not saying SO is bad, but just specifically the practice of blind copy/paste without reasoning about & understanding the code you've copied. SO moderators encourage/semi-enforce descriptive answers for this reason; to add context to the solutions provided.
  • _vertigo 5y ago
    I think on the whole, stackoverflow has vastly improved overall global code quality. Even if you just limit it to people largely taking solutions wholesale from SO, I still think that it’s a good jumping off point. Of course it’s a mistake to not make any modifications or look deeper than the whatever is in the snippet, but the snippet is often much better than what a noob would come up with. Also, it’s an opportunity for learning new patterns that you might not have come up with yourself.
    • lucideer 5y ago
      > Even if you just limit it to people largely taking solutions wholesale from SO, I still think that it’s a good [...] I would respectfully disagree on this point. Anything that perpetuates doing this in any way will always have a negative impact on code quality. If an engineer is copying solutions wholesale, even if those solutions are robust and high-quality, that's an indicator of the approach they have to producing code on a daily basis, which is going to have a much larger overall impact than that 1 answer on SO. SO is imo a net positive benefit to the community, but only by virtue of them doing other beneficial things that balance out with the harm of copypaste programming. But I don't buy that copypaste programming is benign. > Also, it’s an opportunity for learning new patterns that you might not have come up with yourself. Blind copypaste is by definition not an opportunity to learn, because you need to understand (hack/fork/adapt answers given) to learn from them.
      • BiteCode_dev 5y ago
        Why do everybody keep repeating "blind" everywhere? Like it's a curse that can't be avoided. Also why all the anti-copilot seems to think their code is great, or even well understood by themself. I have counterexamples everywhere around me all the time for these 3 points.
• rndgermandude 5y ago
  I honestly never copy-paste from StackOverflow. I go there for general pointers or look at the code snippets and will only use what I think I figured out, and then write code myself. Even that cannot really protect me from missing things like the security implications that this blog post talks about. In this case, I probably wouldn't have fallen for the stuff CoPilot (or an equivalent SO answer) suggested, as I learned about these kind of injection issues a long time ago, but there are certainly a lot of areas where I would fail miserably to detect subtle (security) bugs. APIs are full of subtle and often non-obvious pitfalls, and even algorithms can be, where the algorithm seemingly works except for non-obvious edge cases that you might not have considered.
• skohan 5y ago
  I think the main issue is that many people may not use it that way. When copying from stack overflow, there is some minimum understanding required to adapt the code snippet to match your use of types, variable names etc. With Copilot, there's a high chance you will be able to just accept the autocomplete, and then compile your code. A tool like this has the potential to help good programmers work more quickly, but it carries the risk of acting as a crutch. A lot of people might never put in the work to become good programmers because they learn how to be just good enough at using Copilot to fake it. In a world where there are lots and lots of people trying to gain entry in the software industry, there's a major risk of this leading to a lot of incorrect, and even dangerous code making it into production because nobody really had a look at it.
• bcrosby95 5y ago
  How often do people literally copy/paste from stackoverflow? Because that is what copilot is doing. It's literally pasting in the code for you.
• darkwater 5y ago
  > But they already do the same, just slower, with their current method. I think that when $PROJECT lets everybody do something at a scale that was before impossible, even if it's the "same thing", it is not "the same thing".
  • BiteCode_dev 5y ago
    There is truth in that, people will be tempted more to (mis)use it, because of the lower friction.
• takeda 5y ago
  I see comments like this and makes me wonder if it's a hyperbole or am I the weird one? I admit, there few times I copied but I can count on fingers the number of times I used something from stackoverflow in my entire career (I'm not counting situations when I read somebody's explanation, but didn't use their code, which is just an example of how it works). From posts that I see people write as if they do that daily.
  • sli 5y ago
    I've used plenty of knowledge found on SO but I've never done a direct copy/paste. I also find it kind of weird how "normal" copy/pasting from SO seems to be. It's always paid off better in my experience to take the extra minute to understand the code I would have otherwise copy/pasted, and then implement what I need from it myself. The time savings from copy/pasting seem to average back out later as technical debt when something inevitably has to be fixed or changed.
    • fierro 5y ago
      I mean sometimes you need the exact code described in a SO post, even if it's one line. So you either look at the screen and manually retype it, or copy and paste.
    • BiteCode_dev 5y ago
      copy/paste doesn't imply avoiding to read, understand and modify the code. What with all those false dichotomies? Also SO is only an example. There are many sites, and I call BS anybody who doesn't Ctrl + C once in a while, be it from the docs.
  • nitrogen 5y ago
    Copy/pasting does not lead to understanding. The understanding I gain from not copy/pasting allows me to pursue more difficult projects where there isn't a ready-made answer online. If you want to grow, you have to do the work yourself. And if you want others to grow, make sure your answers give knowledge without giving solutions.
  • neolog 5y ago
• gnulinux 5y ago
  > Unless you never copy/paste from stackoverflow Is this serious? I've never literally copy pasted from stackoverflow. I read the answer and then go write my own code. Did you seriously copy pasted an entire chunk of code and committed it to your codebase after some edits?
  • BiteCode_dev 5y ago
    If you identify it's the right code, why not ?
    • gnulinux 5y ago
      If it's exactly what I want, then I'd be ok. It's just that, that never happened to me. The closest I came was, I was checking a regex and realized I missed some cases, so I copy pasted the regex string from SO. I can't imagine a scenario where a >1 line code in SO can be exactly what my codebase requires. Regardless, my methodology isn't going to SO to find code, I go to SO to read the answers, understand then write code. I never thought when people talk about "copy paste from SO" they literally mean like copy someone's code and paste it to your text editor.
• hintymad 5y ago
  A difference between auto-completed code and stackoverflow answers is that the latter comes with explanations and comments, which help us understand the internals of offered answers.
• gorjusborg 5y ago
  I agree the behavior is similar between copilot and copy/pasting the most popular solution from stackoverflow. However, you seem to be making the argument that is good behavior. I say it is not. The time saved by automating the googling/copying/pasting is miniscule compared to actually understanding the context in which the code is suited and ill suited. That is the developer's work, and it isn't fed by only the code. Developing ain't typing. It's solving problems. Most of the time the problem isn't in code. Even when it is in code, there's nuance in how to best solve it that isn't. The idea that AI is useful in understanding the real world context of the problem better than the human (who has the whole context, in code and outside of it) is naive, or disingenuous.
• majormajor 5y ago
  It's very simple: googling and copying should be a method of last resort. Behind even "googling and learning and then writing your own code based on what you learned," for instance. I'd bet I do it less than once a week. (Trying to find something through google and FAILING to find a useful answer is, sadly, much more common for me.) Copilot makes it a method of FIRST resort. If I know what I'm doing, and know I should escape my inputs... but copilot barfs up a block copied from someone who didn't... now I have to retrain myself to spend time reading the suggested code for stupid shit like that versus just using my own knowledge in the first place. That's a far cry from "i know the method name I want has 'string' in it somewhere"-style autocomplete. You're basically importing a library of "every stupid crap anyone committed to github" and just hoping the the library functions in it are safe and reasonable. That's a crazy dependency to bring into your project if your own programming skills are above that of the median github user.
  • aeorgnoieang 5y ago
    > That's a crazy dependency to bring into your project if your own programming skills are above that of the median github user. So, roughly half of programmers would be _better_ served just blindly using Copilot's suggestions then? Personally, I find that I work with so many different things so often that I "googling" is often much quicker even than reading documentation or even searching my own existing code. But I also have _zero_ interest in Copilot at all, so what do I know?
• bogota 5y ago
  I don’t understand. I never have copy pasted from SO after my first few years of work. At that point you normally are already using libs that take care of most things you would copy paste and are hopefully working ok things more complex than just piecing together sporadic SO posts. The code i produced during my first few years isn’t something anyone should aspire to. Additionally you likely learned over time that most SO posts are not great but provide a good starting point.