3 ms·

I didn't see mention of who would pay for this infrastructure. Is it considered a gov't funded or volunteer / donation thing? There doesn't seem to be a mentio

by iamwil 8y ago

I didn't see mention of who would pay for this infrastructure. Is it considered a gov't funded or volunteer / donation thing? There doesn't seem to be a mention of how to alleviate a tragedy of the commons problem (unless I missed it). If common crawl is doing a fine job, who funds them?

ericd 8y ago
Maybe the crawl could be distributed somehow, and you could pull versions of the web from those distributed nodes via BitTorrent.
bobajeff 8y ago
The PDF near the end mentioned the EU as an example on who could fund it.