13 ms·
I understand the problem here and I sympathize with professors in these circumstances. Learning the fundamentals will remain important. But as others have point
by cmrdporcupine 4y ago
I understand the problem here and I sympathize with professors in these circumstances. Learning the fundamentals will remain important. But as others have pointed out: if students are unwilling to learn, or are taking shortcuts, it will ultimately hurt them in the long run.
One thing tho is that things like Copilot put the lie to the hypothesis (propagated mostly by the Google-style job interview) that intensely coding clever for-loops to perform algorithmic magic (for things usually already in the standard library) is the best measure of the competence of a software developer. If it can literally be done by a machine, maybe we should be measuring based on something else. Especially since this kind of thing is best done on the job by looking in a good textbook or using the standard library. Probably grading at the university level needs to consider this also.
I haven't used Copilot. I doubt I'm its intended audience. After 30 years, actually writing code is perhaps the easiest part of my job. The mechanics is the easy part. The big picture thinking and figuring how to get it all together into a system is the hard part (and honestly there are plenty of people far better at it than I am). Now, if we get a Copilot for that ... then our profession is in trouble.
- eloff 4y agoI was skeptical of copilot, but since trying it for two months, I'm really impressed. It's a smarter auto complete. For $10/month it pays for itself in one day. You have to be careful with the output it produces, as it often looks sensible but is wrong. Especially if it contains numeric constants. But on the whole it speeds things up, the same way good code auto complete does.
- thefourthchime 4y agoI've been writing code for nearly as long and man, you have to try it. It's more like autocomplete on roids than something that generates Fibonacci methods automagically.
- ALittleLight 4y agoI've used Copilot for a little while. I'm away from my computer at the moment but I'm very confident it would generate Fibonacci methods.
- glacials 4y agoI don’t think they mean that it can’t, just that the better way to think about the advantages it gives an experienced engineer is more along the lines of “autocomplete v2”, i.e. a keystroke-saver.
- andrepd 4y agoIs it a keystroke saver if you need to review every line it proposes to you?
- matthewmacleod 4y agoYes. For my part, it's a very obvious boost in exactly that sort of keystroke-saving way. Here's an example I just now tried in the codebase I had open. I literally typed in the following Go in a function: mean := geom.Vec3D{} for Copilot then autocompleted this, me pressing tab to accept each line, to: mean := geom.Vec3D{} for _, detection := range filtered { mean.X += detection.X mean.Y += detection.Y mean.Z += detection.Z } mean.X /= float64(len(filtered)) mean.Y /= float64(len(filtered)) mean.Z /= float64(len(filtered)) It's not a perfect platform by any means, but it's also pretty useful for this sort of autocompletion.
- gopher_space 4y agoI can picture autogen boilerplate being collected and distributed in versioned "community expansion packs" to popular languages, and I'm not looking for fragmentation like that in my tools. I really don't want my IDE involved like this. I'd rather see Copilot used to expand existing libraries. Pulling potential additions to your own library off of Copilot would be an interesting twist on the situation. A hacktoberfest-alike based off this would be weird.
- Fogest 4y agoNobody is forcing you to use it... Others like myself find it useful and to be a huge timesaver. If it doesn't benefit you, then just don't use it. Why must people be so vocal about not liking something? I get that you don't think it would be useful for yourself, but it sounds like you've never used it, yet are against it enough to come bash on it in a thread. I think you should give it a try and see what you think about it. I was hesitant about it at first but was very surprised at how much time it could save me from having to look up things on Google. I've found it especially useful when I'm switching to a language I may be less familiar with. I can understand the basic logic of what I want to do, but would have to spend time looking up how to do it in this specific language. Orrr... I just have copilot help me out and generate such a solution. It's obviously not going to be a tool that is applicable to everyone. Just like how many manual labour oriented contractors have a bunch of tools, each of them may have their own set of tools that slightly differs from the other person. That is okay, and there would be no need to try and bring someone else down for their choice to use a certain tool.
- fassssst 4y agoRTFA :)
- cmrdporcupine 4y agoI will try it at some point, but I have... feelings... about its abuse of open source licenses software as a learning set. Also I work in Rust these days, and use CLion. Not sure if it would be much help in that environment.
- bayindirh 4y agoI left GitHub on the spot, and moved to Source Hut the day Copilot released.
- MichaelMoser123 4y agosomeone can still mirror your stuff on github. I wonder if they should make a special open source license, that disallows use of the source code for the purpose of training something like Copilot.
- dragonwriter 4y ago> I wonder if they should make a special open source license, that disallows use of the source code for the purpose of training something like Copilot. Since Microsoft uses material for copilot outside of licensing on the basis that it is Fair Use, that would probably have no effect in practice on whether or not the material is used in training something like Copilot. For that to matter, you’d first have to win a lawsuit on the basis that training something like Copilot requires permission of the copyright owner of the training material, to invalidate the premise of Microsoft’s action.
- MichaelMoser123 4y ago> Since Microsoft uses material for copilot outside of licensing on the basis that it is Fair Use, that would probably have no effect in practice i think that any formal violation of an open source license would be very bad in terms of public relations - even if they can claim fair use.
- 4y ago
- throwaway6977 4y agoYup exactly, and the ability to basically be fluent in any language.
- TheRealPomax 4y agoNot until there's a setting that can guarantee the automcomplete is based on verifiably license-unencumbered source that is automatically tracked in some kind of sourcemap that tells me which parts of "the code I didn't write" comes from which other project and file inside that project. Until then, copilot is a giant liability that ensures I can't use it for code that my company ends up owning, nor can I contribute code I write with it to literally any open source project because in a very real sense: I didn't write it. I just assembled it from parts unknown, and those parts may end up being lawsuits.
- thaeli 4y agoI would also be comfortable with a service that was willing to broadly indemnify me as the customer from copyright and patent claims arising from code generated by their service. I doubt that will ever happen either.
- honkdaddy 4y agoAs a hypothetical, what would that case actually look like? I'm suing you because I have a strong belief that part of the codebase of your personal project was assembled from code I wrote and didn't license permissively, so now I'm claiming ownership? Obviously IANAL so this is largely conjecture, but until we _actually_ see how this would play out in court, I'm leaning towards this being less of a legal issue than folks here act like. For personal projects, I'd say the likelihood of some other engineer reading your code, noticing a similarity or duplication, and dragging you to court for it is near 0.
- TheRealPomax 4y agoAs hypetheticals: - "you were hired to write code for us, not to use an autocomplete service that makes us liable for both copyright and patent lawsuits, I hope you like getting fired." - "as per this project's license, we can only take code on board that you contributed under our license, but an audit shows that your PR/MRs contain tons of GPL/MIT/Whatever licensed code instead. We're going to have to back all of that out, and we're going to revoke your contributor status" - etc. If you don't know where the code in your autocomplete comes from (and copilot can autocomplete large swathes of code) then literally anything that comes out of "you didn't write this code" may apply. From fraud (depending on what contract you signed) to trademark infringement, to license violations, to even just simply misrepresenting your skills to an employer. As with all things, it's a sliding scale, but just because the majority of incidents will be on the bening part of the spectrum doesn't mean the litigating part doesn't exist, and that's what your legal department plans for. Work for a big company? Good bet you're not allowed to use copilot. And depending on the company, not even "for your personal projects" because you might accidentally read someone else's license encumbered code that you would not have come up with yourself and may now open your employer up to "you stole our ideas instead of properly crediting/paying for licenses". Copilot is a legal nightmare.
- Beltalowda 4y agoI found carefully reviewing the suggestions it gave me more work than actually writing the code myself. Granted, I only used it for a day, but many of the suggestions were subtly wrong, needless inefficient, or used outdated/deprecated paradigms/standard library stuff. I only used it for a language I'm very familiar with. I'd be a lot more hesitant using it for a language I'm less familiar with because I won't be able to spot the problems so easily.
- nsxwolf 4y agoI’ve really found no use for it at all. It doesn’t understand the codebase it’s being used in. I can’t tell it to write a service that gets data from another internal microservice, oh and make sure you do it in the same way the other services are implemented so that this passes code review… it can cough up slightly wrong answers to leetcode problems, but who has a job where that’s useful?
- lolinder 4y agoI've found it extremely helpful in writing highly repetitive code that's too complicated for a Regex find/replace. For example, I used it when writing a recursive descent parser in Rust for a hobby project. I wrote the grammar in a comment at the top of the file, wrote and imported the AST enum, and wrote the first production. After that, I just prompted Copilot and it worked its way down the grammar, producing the parser functions one at a time. The CLion integration was able to consider the imported data structures as part of the prompt, so it even stored everything in the correct AST nodes. For something like that, it's easy to verify that it did it correctly (through visual inspection and testing), and it allowed me to write the entire parser in about 2-3 seconds per rule.
- xigoi 4y agoWhy not just use a parser generator?
- t_mann 4y agoLeetcode interviews have maybe just become an example for https://en.wikipedia.org/wiki/Goodhart%27s_law https://en.wikipedia.org/wiki/Goodhart%27s_law - as long as people aren't aware, it's a great signal, but after people catch onto it, it becomes a measure of something else
- tgv 4y ago> if students are unwilling to learn, or are taking shortcuts, it will ultimately hurt them in the long run That's a very limited, and dismissive view. If you allow students to use copilot, you're handing out certificates or diplomas to people who can't code. That will very quickly erode the value of your institute's certification, and with it, that of the other students. Otherwise, why not give everyone an MSc in CS? "It'll only hurt themselves in the long run". > coding clever for-loops to perform algorithmic magic A for loop for searching or summation is not algorithmic magic. > maybe we should be measuring based on something else No, why? Students have to understand the fundamentals. What those fundamentals are depends on the expertise. Once you've shown mastery, you can use more advanced tools. Teaching has always been like this, and for a good reason.
- geraldwhen 4y agoMost people I meet with CS degrees cannot code. Not anything. Some can’t declare variables or get a file to compile.
- gentleman11 4y agoYour actual problem is that you are stressing people out so badly that they cannot think, then asking things of them while expecting them to fail
- geraldwhen 4y agoI let people use their own computers, own IDEs, own programming language, own testing framework. A CS degree is worth nothing. A masters is worth even less.
- xigoi 4y agoIf you forget the basics of your favorite programming language under stress, you might not be suited for a programming job.
- hedora 4y agoI've interviewed lots of new grads, and also observed my own classmates. Most institutions have been granting CS diplomas to people that cannot code for decades. Those people tend not to find long-lasting programming jobs.
- x86x87 4y agoThe grind you have to go through in a "google style" interview has nothing to do with the actual work you normally do. It's done to show 1) you will do large amounts of boring work without questioning the need for it 2) you got the fundamentals and you know what's there / when using something you can grok what's going on under the covers. Nobody needs to implement a sorting algorithm until they do - the risk of NIH and reinventing the wheel is high. When you do you need to have a good understanding of why
- josephg 4y agoNobody at Google wants you to do boring work without questioning the need for it. That would be a waste of money and time. Hard interview questions are asked for the same reason hard questions are asked in SAT tests. The assumption is that if you can do a hard thing in the interview (implement a mutex using a semaphore or whatever) then you can probably write simple code too. A few years ago I was working somewhere that had a low hiring bar. We were using an opensource graphql library to interact with some service. The graphql library didn’t expose some queries we needed, so I forked the library and added those queries. After I left I heard through the grapevine that they were very unhappy with my work. They didn’t have anyone on the team who was skilled enough to maintain the code I wrote, so I left them in a bad place. In retrospect I’m still not sure what else I could have done to solve the team’s graphql problems. Not that, but what?
- x86x87 4y agoI'm going respectfully disagree with you on the first point. Do you really need a Phd to maintain an internal javascript framework with a handful of users? (True story). A lot of the hires are made to starve the competition of good people. The low hiring bar is relative. If all you do is put together crud apps and it's mostly stitching things together you might not even need a formal CS education. In fact a lot of people I know are wildly successful because they found their niche. They would have an exceptional bad time in a whiteboard setting.
- codeflo 4y agoI’ve seen many instances where a low-skill programming place either lives with a bug, or alternatively, adopts a solution that involves meticulously copy&pasting a workaround into 300 places. Having said that, I know great, intelligent programmers, sone of who worked on compilers, who are simply bad in a whiteboard setting. Having a filter is necessary, I’m just not convinced a Google-style interview filters exactly the right thing.
- deleted 4y ago[deleted]
- alain94040 4y agoCopilot doesn't change the fact that trivial questions (such as 'write a Fibonacci function') can already be googled. What I don't know (I can't try the 'free' Copilot without providing a credit card), is how well it understands unusual constraints and separate pieces of C++ classes that make the real programs we write. For instance, a simple test would be: "write a fibonacci function but skip the number 5". Does it do the right thing? Another challenge would be a C++ class with several fields. That's what our real programs look like: composite data objects, mixing several different algorithms together to implement complex behavior. Maybe my data structure has a hash table of items, as well as a direct link to the largest item. When I say: "write the function to insert a new item in the list, and remember to update the largest item if it is larger than the current one", would Copilot do the right thing? Each step is easy in itself (adding an element to a hash, comparing an item to another one).
- wilg 4y agoI (surprisingly) could not get it to generate a Fibonacci function that skips 5.
- thewebcount 4y agoAs a human, I’m having trouble understanding the problem description. What does it mean to “skip 5”? I’ve always understood the definition of a Fibonacci sequence to be, starting with 2 numbers (usually 1 and 1) the next number in the sequence is the sum of the previous 2. So starting with 1 and 1, we get 2. 2 and 1 is three. 3 and 2 is five. What do we do from here? Do I not add 5 and 3? If not, then what do I add? 3 and 2 again? Do I repeat 3 and get 6? What does it mean to “skip 5”?
- baby 4y agoIf you’re writing code you are the audience for copilot. Just try it
- Brian_K_White 4y agoThis sounds kind of creepy culty. I think it's the pushing "just try it" vs merely reporting "I like it".
- netr0ute 4y agoIf you're into being hydrated, water is great. Just try it
- Brian_K_White 4y agoExactly. Since it was so great, I didn't need to be told to try it, and what's it to you if I do or don't?
- Fogest 4y agoAnd if you were given an IDE from a young age with copilot you also wouldn't be told you needed to try it...
- LtWorf 4y agoIt's not even free. I have to put in the credit card number to just try it.
- shmoogy 4y agoIt saves me more time than the monthly cost of the service. I've never tried things like Jedi or copilot before - I definitely enjoy it more than I thought I would.
- baby 4y agoI’m tired of people saying things like that when they haven’t tried copilot. So now I’m just saying “try it, we’ll see how you feel after that”
- greymalik 4y ago> the hypothesis (propagated mostly by the Google-style job interview) that intensely coding clever for-loops to perform algorithmic magic (for things usually already in the standard library) is the best measure of the competence of a software developer I think the hypothesis is, rather, that people who can successfully run that gauntlet are smart and motivated. The details of the problems they’re solving along the way are almost incidental.
- Applejinx 4y agoI code for a living and Copilot can't do the least part of my job, though it is possible it could find uses here and there around the fringes (perhaps not even then). I'm coding audio DSP along the lines (real example here) of, "Given that the Dolby noise reduction system is deeply part of the sound of classic seventies and eighties recording, what parts of it can be generalized to make DSP processing producing the same general effects on the sound, and having done so, how should this be tweaked and adjusted to optimize for pleasurable results?" This doesn't exist on Copilot. Damn near nothing I do for work exists on Copilot, and even if it (being an MIT-licensed public code library) gets slurped up into Copilot, Copilot has absolutely no way to determine whether a 0.8273 in the algorithm should be leaning towards 0.83 to brighten the sound of something happening, that it would do this, or why you'd want brighter rather than darker, or whether you are right in wanting this or would do better to go darker knowing that other things will happen to the listening experience. Copilot's inability to do these things is much like Dall-E's inability to do art. There is much visualization and a striking absence of purpose or intention. With Copilot, it will do all the boring or common stuff for you. If that's your job, maybe you're not aiming at the strengths of humans, rather you are aiming at things too easy to automate…
- babyshake 4y ago> Especially since this kind of thing is best done on the job by looking in a good textbook or using the standard library. The way that job interviews continue to fixate on having a huge amount of information stored in your head, rather than your ability to be resourceful, is so frustrating. Oh well, maybe it's about time I go back to Leetcode and see how quickly I can grind out a recursive DFS algorithm...
- LtWorf 4y agoIn my master program in CS there was a guy unfamiliar with the concept of "find the minimum number in an array". Turns out he just had paid someone to do all of his assignment in the bachelor.
- salty_biscuits 4y ago"our profession is in trouble" Or the world will shudder at the Byzantine monters we can pump out day after day
- RcouF1uZ4gsC 4y ago> After 30 years, actually writing code is perhaps the easiest part of my job. The mechanics is the easy part. Actually Copilot can really help people like you. Even if the mechanics is the easy part, knowing how to touch type and knowing an editor like vim, can help you get your thoughts from your mind into code faster. Copilot can do the same thing. It can act as a super powerful text editor augmentor to get your thoughts into code faster. Just because the straight ways of a racing course aren’t the most challenging, doesn’t mean that going faster on them won’t improve your racing performance.
- Aeolun 4y ago> I doubt I'm its intended audience. After 30 years, actually writing code is perhaps the easiest part of my job. I think that’s exactly the intended audience. Copilot just cannot write code for me, but it’s really good at inferring patterns and giving me the next step. All the boring repetitive coding has disappeared.
- giancarlostoro 4y ago> using the standard library This is why I care more that you can tell me about the algorithm at a high level, and reasons to use it. I don't care about you writing code outside of a computer. I don't write code on paper and then write it in my editor. I open up my browser, look up the documentation and refresh my understanding of the algorithm to make sure I am not overlooking anything. I do some research to figure out if I even need it, maybe there's some even superior way to do what I'm trying to do in my programming language at that moment.
- jacquesm 4y ago> After 30 years, actually writing code is perhaps the easiest part of my job. The mechanics is the easy part. The big picture thinking and figuring how to get it all together into a system is the hard part This is the thing that you won't be learning about in a bootcamp. Coding is easy. Knowing what to code is hard, sometimes very hard. As is keeping it simple.
- fantispug 4y agoThis happened in mathematics about a decade ago when Wolfram Alpha came out. Lecturers started complaining that Wolfram Alpha could solve assignment problems with worked steps. In both cases I think this is a real opportunity; we can let students get more quickly to bigger problems and systems thinking by leveraging these tools. It requires professors to start thinking innovatively about how to teach and assess these subjects.
- bergenty 4y agoAnd it does. Kids use wolfram alpha for a lot of the first and second year math courses in college now.
- bergenty 4y agoThere is a copilot for that. I think you’re making programming seem more intricate than it is. It can build a crud app. It can build distributed systems. It can write web3 contracts. There’s not a whole lot besides that except maybe rare structural projects that don’t happen very often.
- baby 4y agoI had a C class in my first year of bachelor and the exam was a paper exam where we had to write code by hand. I thought that was dumb but now it sorts of makes sense.
- xupybd 4y agoI was not sure about copilot but it's amazing. You can put your pseudo code up in comments and it fills out the boiler plate. For things like plumbing info from the db to the front end it's amazing how much time it saves.