5 ms·
It seems like Common Crawl is doing a lot of awesome stuff, but they're not attacking Google's stranglehold head on. Presumably this is because they lack the m
by staunch 6y ago
It seems like Common Crawl is doing a lot of awesome stuff, but they're not attacking Google's stranglehold head on.
Presumably this is because they lack the money to do so. Have they attempted to estimate how much it would cost per year to crawl the web as aggressively and comprehensively as Google does? I've checked their site and didn't find anything like that.
If they came up with a number, say $2 or $10 billion per year, it might actually be possible to gather enough donations to dethrone Google.
A lot of Google competitors would love to see them dethroned. And it would be a huge win for virtually everyone else too. There's no one in the world that wants Google to maintain their web search monopoly indefinitely.