To say nothing of the engineering challenges with crawling the entire Internet. Your first cut will likely refresh every several months or so. Remember when G

To say nothing of the engineering challenges with crawling the entire Internet. Your first cut will likely refresh every several months or so. Remember when Google did that, back in like 2005? It was very effing hard then. Google now crawls pages newly linked from authority sites essentially instantaneously.