3 ms·
The point of having many people run it is to maximise the number of different IP addresses scraping the data. Even if you are only using a small percentage of
by codetrotter 3y ago
The point of having many people run it is to maximise the number of different IP addresses scraping the data.
Even if you are only using a small percentage of your available bandwidth you are still helping out by running this.
If they attempted to max out the download bandwidth of all clients they’d only end up getting everyone IP banned by Reddit, and then the scraping would not be successful.
So even if most time is waiting to upload the scraped data, it’s still good.
Slow and steady.