2 ms·
It's very hard to impossible to prevent screen scraping. In the worst case scenario, the person scraping uses a Firefox instance running on a real display and c
by dalke 14y ago
It's very hard to impossible to prevent screen scraping. In the worst case scenario, the person scraping uses a Firefox instance running on a real display and controlled via a system like Sikuli to control the mouse the same way that a human would do it.
No, I take that back. The worst case scenario is hiring a team of people in some low-wage country to manually go through the site to extract the information.
How do you prevent those cases? I think the most you can do is throttle based on a mixture of login account and request IP address.
That said, the first step is to develop a threat model. You need to get an idea of why would people want to scrape your site, the incentive for them to do so, and the effect on your site and business if your data is scraped.