3 ms·
If it's a desktop app and the crawling is not centralized, I doubt they'd be able to do much about it. Lot of crawl-heavy SEO tools work this way.
by dhruvkar 9y ago
If it's a desktop app and the crawling is not centralized, I doubt they'd be able to do much about it.
Lot of crawl-heavy SEO tools work this way.
- ezekg 9y agoIdk, I had a free open source command line project that scraped flight data and that got shut down. It might have been the particular airline, though, because they specifically disallow scraping from all third-parties including eg Google Flights, SkyScanner, etc.
- dhruvkar 9y agoInteresting. As a consumer, I'd love to see something in that space. I hate paying for most things, but a desktop app that allows me to search for rewards miles would be something I would pay a yearly fee for.