3 ms·
Scrapers are orders of magnitude faster than humans at browsing websites. If the challenge takes 1 second but a human stays on the page for 3 minutes, then it's
by Almondsetat 1y ago
Scrapers are orders of magnitude faster than humans at browsing websites. If the challenge takes 1 second but a human stays on the page for 3 minutes, then it's negligible. But if the challenge takes 1 second and the scraper does ita job in 5 seconds, you already have a 20% slowdown
- deleted 1y ago[deleted]
- rfoo 1y agoScrapers do not care about having a 20% slowdown. All they care is being able to scale up. This does not block any scale up attempt.
- mewpmewp2 1y agoBy that logic you could just make your website in general load slower to make scraping harder.
- Almondsetat 1y agoNo, because in this case there are cookies involved. If the scraper accepts cookies then it's trivial to detect it and block it. If it doesn't, it will have to solve the challenge every single time.