4 ms·
The dataset is all freely available open source code, right? Just because GH hosts it doesn’t mean the rest of the world can’t use it for the same purpose.
by djrogers 5y ago
The dataset is all freely available open source code, right? Just because GH hosts it doesn’t mean the rest of the world can’t use it for the same purpose.
- midoBB 5y agoYou'd have to hit rate limiting multiple times no?
- kall 5y agoArenmt mirrors of all GH code available, for example on BigQuery public datasets. If it‘s there, it should be available in a downloadable format too?
- goodpoint 5y agoNot only that, but microsoft could aggressively throttle or outcompete anyone trying to do the same.
- unfunco 5y agohttps://console.cloud.google.com/marketplace/product/github/github-repos?filter=solution-type:dataset https://console.cloud.google.com/marketplace/product/github/... BigQuery used to have a dataset updated weekly, looks like it hasn't been updated since about a year after the acquisition by Microsoft.
- handrous 5y agoThey'd find a way to keep it practically difficult to use, at the least, if that dataset is vital to the process. Hoarding datasets that should either be wholly public or unavailable for any kind of exploitation is the backbone of 21st century big tech. It's how they make money, and how they maintain (very, very deep) moats against competition. [EDIT] actually, I suspect their play here will be to open up the public data but own the best and most low-friction implementation, then add terms that let them also feed their algo with proprietary code built using their editors. That part won't be freely available, and no free version will be able to provide that further-improved model, even assuming all the software to build it is open-source. Assuming using this thing ends up being a significant advantage (so, assuming this matters at all) your choice will be to either hamstring yourself in the market or to help Microsoft build their dataset.