2 ms·
It’s also difficult to trust decentralized crawling infrastructure. How do you know that crawlers are reporting honestly?
by notduncansmith 7y ago
It’s also difficult to trust decentralized crawling infrastructure. How do you know that crawlers are reporting honestly?
- MadWombat 7y agoHopefully this could be market regulated, if a particular crawler gets caught making things up or doing otherwise a bad job crawling, indexers could simply stop using it in favor of a different crawler.