3 ms·
Did they scrape indiscriminately, or did they pay for access? I'm hoping it was the latter so you were able to keep the site self-sustaining for a while longer.
by otoburb 9y ago
Did they scrape indiscriminately, or did they pay for access? I'm hoping it was the latter so you were able to keep the site self-sustaining for a while longer.
- wgerard 9y agoThe info was gated behind a paid login, so thankfully we didn't have to worry too much about scrapers. We also set up a notification system when new campaigns came out, so they didn't have to long poll for new info. We actually did have quite a few people scraping our homepage for some reason (which was rarely, if ever, updated) but they were mostly other aggregators as well, not potential clients.