3 ms·
Bing has this indexed, so I'm assuming DDG is finding it from there. (Bing is also, unfortunately, also returning results that do not have the string present, w
by shadowgovt 5y ago
Bing has this indexed, so I'm assuming DDG is finding it from there. (Bing is also, unfortunately, also returning results that do not have the string present, which depending on how one tunes one's success metrics is worse... Remember the bad old days of sifting through search hits to not find the information the engine claimed was on the page?).
There's not a lot one can glean about the operation of a search engine from one anecdote; any number of things (including the backing store on which the one copy of this data is indexed being temporarily unavailable) can explain a failure-to-find like this.
But this story does point to both an advantage a meta-search like DDG has and a best practice: different search engines will give different answers. Keep several in your back pocket; don't assume Google is omniscient.
- kyrra 5y ago(googler, opinions are my own. No insider knowledge about this discussion.). Bing and Github are both owned by Microsoft. Maybe there are different scraping/throttling rules in-place on Github between Bing and Google?
- mh- 5y agoDoesn't look like it. https://github.com/robots.txt https://github.com/robots.txt
- shadowgovt 5y agoIt may also be server-side instead of client-side, which we wouldn't be able to see out here. If Bing has a dedicated crawler for GitHub (or a back-channel to crawl its databases directly).