Good addition, in this way, we all would be a gigantic crawler. I think the trade-off here is the latency and data-loss? Or data-loss could be resolved by intr

Good addition, in this way, we all would be a gigantic crawler. I think the trade-off here is the latency and data-loss? Or data-loss could be resolved by introducing some sort of redudancy. Like how seeding works in torrents.