3 ms·
Stackoverflow at least has the benefit of whatever comments might be around it. As far as I can tell, the copilot suggestion doesn't have any way to rate it, ma
by tyingq 5y ago
Stackoverflow at least has the benefit of whatever comments might be around it. As far as I can tell, the copilot suggestion doesn't have any way to rate it, make a comment, flag it, etc.
- jfoster 5y agoI think they kind of do. On the Telemetry section of the Copilot site, they mention that they relay whether a suggestion was accepted or rejected. I wonder, how much better could Github Copilot become by also looking that the modifications that are subsequently made to the accepted suggestions? Obviously this would go quite a bit further in terms of telemetry, and may become an issue. They would essentially be training based on non-public code at that point.
- tyingq 5y agoI guess that's a start, but I think comments, flagging, would have value. There's lots of reasons you might not accept something.
- ffhhj 5y ago> On the Telemetry section of the Copilot site, they mention that they relay whether a suggestion was accepted or rejected. That will make it the target of a collaborative bias attack.
- naniwaduni 5y agoWait, are we sure it'd need to be collaborative?
- ratherbefuddled 5y agoI'm guessing but surely it reads the code you end up with and uses that to train?
- e_proxus 5y agoSo it will be self-reinforced to get worse and rot over time? Since surely all code that used Copilot will be slightly worse than code without (extrapolated on the assumption that Copilot is wrong some of the time).
- squeaky-clean 5y agoAgreed. How many times have you seen the "accepted" answer on a Stackoverflow be suboptimal if not outright wrong, and a much better answer is lower down the page. For me it feels like 50% of the time or more.