3 ms·
GitHub and other companies like Amazon have the advantage of the scale in terms of dataset. What’s the guarantee that the pre trained model you have that you’ll
by alsodumb 4y ago
GitHub and other companies like Amazon have the advantage of the scale in terms of dataset. What’s the guarantee that the pre trained model you have that you’ll fine tune on a company’s code base is as good as say Copilot? It makes it even hard to evaluate when you don’t have a demo to try - it’s not that hard to setup a pipeline to run your model in cloud and send invites to potential customers if you want to.
- sebzim4500 4y agoWasn't copilot only trained on public GitHub repos? Presumably there's nothing stopping anyone from training on them.
- taptaptoe 4y agoYea, there are tons of public data to train on. Copilot's under fire right now: https://githubcopilotlitigation.com/ https://githubcopilotlitigation.com/, but we make sure we only train on permissively licenses because some companies are sensitive to the IP issues here.
- gkbrk 4y agoCan you give a list of the permissive licenses you train on? MIT for example requires attribution. In fact, most permissive licenses have similar requirements.
- kbaker 4y agoMIT only needs attribution for redistributing "all copies or substantial portions of the Software". Juat reading the code shouldn't be illegal, and producing a short snippet based on the code but not identical shouldn't count as a "substantial portion", but IANAL...
- swatcoder 4y agoIt doesn't make sense to treat Copilot as a competitive benchmark where Copilot isn't even an option for policy reasons, which is what this product is targeting. Does it provide net positive support to developers? Is that support worth the licensing and maintenance costs? Those would indeed benefit from a demo, but it's also hard to demo something whose value hinges on fine-tuning. More likely, they'll need to sell low-risk, supported integrations that help an org stand up the project on their own system and evaluate its quality in situ. It's a whole different model than retail SaaS services like Copilot. This is an exciting announcement for a product meant to fill a gaping hole. The orgs that need it will just have to see how well it works for them.
- taptaptoe 4y agoThank you!! You've hit the nail on the head and our thoughts exactly. One anecdote is we offer video demos and one potential customer just said, "I don't need to see it. I know what Copilot does." We do offer pilots for customers after fine-tuning on their codebase!
- RayVR 4y agoWhat compliance issues are there? Copilot is already being adopted at the enterprise level. Microsoft is not going to miss out on enterprise by trying to ship data out.