2 ms·
Web crawl can be an ok use case actually. The idea then would be to "reindex" the world. It might seem ludicrous, but to give you an idea, indexing CommonCrawl
by fulmicoton 3y ago
Web crawl can be an ok use case actually.
The idea then would be to "reindex" the world.
It might seem ludicrous, but to give you an idea, indexing CommonCrawl takes about a day with 8vCPUs.