3 ms·
I would like a service that just keeps an up to date corpus of the web. Or at least the top few terabytes. Then I can pay the few dollars a month to run a giant
by prepend 8y ago
I would like a service that just keeps an up to date corpus of the web. Or at least the top few terabytes. Then I can pay the few dollars a month to run a giant map reduce grep on it.
For most of my searches, debugging a few specific strings, I really just need grep. It’s too much for one person to crawl the web. But a good distributed network could.