3 ms·
Is there nuance here in what is used to train vs what is used in completions? For example, if all public code was used to train a ML model, but then the autoco
by shireboy 5y ago
Is there nuance here in what is used to train vs what is used in completions? For example, if all public code was used to train a ML model, but then the autocomplete feature only pasted in uniquely generated or licensed code, that would be different than if it pasted in verbatim licensed code without attribution or whatever the license requires.
It could be like a dev reading public code enough to understand it, but then coming up with her own implementation. Not saying copilot works that way - I haven’t tested it yet. But could be one nuance here.
- Tenoke 5y agoThere's many things you can potentially do at a loss of performance. E.g. train it on all the code initially to learn the general rules better but then finetune only on the subsection that is of the right license or write something into your inference that checks how close to existing code the output is etc.