3 ms·
(googler, opinions are my own. No insider knowledge about this discussion.). Bing and Github are both owned by Microsoft. Maybe there are different scraping/
by kyrra 5y ago
(googler, opinions are my own. No insider knowledge about this discussion.).
Bing and Github are both owned by Microsoft. Maybe there are different scraping/throttling rules in-place on Github between Bing and Google?
- mh- 5y agoDoesn't look like it. https://github.com/robots.txt https://github.com/robots.txt
- shadowgovt 5y agoIt may also be server-side instead of client-side, which we wouldn't be able to see out here. If Bing has a dedicated crawler for GitHub (or a back-channel to crawl its databases directly).