3 ms·
Whenever I've used Copilot it never seems to copy whole sections of code. Can you provide examples of this? From what I've seen it is producing fairly generic
by throwaway4aday 4y ago
Whenever I've used Copilot it never seems to copy whole sections of code. Can you provide examples of this?
From what I've seen it is producing fairly generic boilerplate that has been modified based on the rest of the code in my repo so that it works with the other functions and even incorporates other pieces of my code in the same style that I'm using. The boilerplate aspect makes sense because this would be the most common sequence of tokens that it observed during training. It's somewhat miraculous that it can incorporate code on the fly from my repo. I've never seen anything that looks like a direct copy paste from elsewhere though. If you have a different observation I'd love to see it.
- EamonnMR 4y agoBehold: https://twitter.com/StefanKarpinski/status/1410971061181681674 https://twitter.com/StefanKarpinski/status/14109710611816816... Probably helps that this is from a codebase that's been forked quite a bit.
- judge2020 4y agoYou can't even code search in forked repos so maybe forks were excluded (besides commits on top of the fork)?
- EamonnMR 4y agoMost forks probably happened before GitHub existed.
- throwaway4aday 4y agoYeah, I wanted an example from a real project not a one file demo. The high fork number and probably also its existence in thousands of other projects likely results in this behaviour if you have no surrounding context. This is also easily solved by checking the box in Copilot that says not to produce any code matching public code.
- robertlagrant 4y agoCan I circumvent the new OGL revocation by training an AI on 100 copies of the D&D rulebook, and using its output?