4 ms·
There is a huge difference between adblock and a scraper. The scraper is automated browsing and data harvesting. This can be quantified and creates extra load.
by White_Wolf 6y ago
There is a huge difference between adblock and a scraper. The scraper is automated browsing and data harvesting. This can be quantified and creates extra load. Adblock works with local data after the server did it's part and sent all data to the device. It doesn't create additional load on the server.
- toomuchtodo 6y agoA fair compromise would be a scraper that runs as a browser extension, so as to not create extra load (for example, RECAP [1], which scrapes PACER and ships the viewed case PDFs off for archiving and indexing). Shipping post, link, and comment data somewhere globally accessible using a browser extension while logged in sidesteps Reddit’s walled garden efforts without any load beyond that which they would’ve expended serving typical user requests. Maybe IPFS as a target? [1] https://free.law/recap https://free.law/recap
- White_Wolf 6y agoYes. That would be a great middle ground. As a side note:I am pro-scraping as long as common sense has a say in it and it's not abused. I do scrape one in a blue moon when I want to research a topic in depth.It's great for gathering a lot of information to help learn about a topic fast(er).