5 ms·
I've used this and it's invaluable for all types of things but a feeder for Google killers it is not. They don't approach the scale of what Google crawls, they
by Grimm1 6y ago
I've used this and it's invaluable for all types of things but a feeder for Google killers it is not.
They don't approach the scale of what Google crawls, they state as much. Nor do they do it on the same timeline as Google. This is really nice for research or kick starting a project but this isn't a long term viable solution for alternative search engines. Between breadth, depth, timeline/speed, priority, and information captured it falls well short.
- ziftface 6y agoWell that's to be expected, but if a lot of search engines start using it, it's likely that websites will start allowing it to crawl and index their pages. So there might be potential there.