3 ms·
I think the challenge is solving it in a way that users can still use the product. I’ve done a fair bit of scraping for various things. Companies that attempt
by MattGaiser 2y ago
I think the challenge is solving it in a way that users can still use the product.
I’ve done a fair bit of scraping for various things. Companies that attempt to defeat scraping often ruin the user experience along the way.
As an example I am aware of, there is an airline that keeps doing all sorts of things to defeat scrapers.
Problem is, the site now constantly throws errors for regular users doing searches and people are regularly getting banned for doing too many searches.
And they still haven’t done much but made scrapers increase their retry counts.