3 ms·This doesn't work with the kind of highly distributed crawling that is the problem now.by idlewords 2y agoThis doesn't work with the kind of highly distributed crawling that is the problem now.