2 ms·
Crawling Amazon is no longer feasible if you want up-to-date prices. There's 10s of millions of pages to crawl, it takes too long. I believe they also added cap
by lazyjones 11y ago
Crawling Amazon is no longer feasible if you want up-to-date prices. There's 10s of millions of pages to crawl, it takes too long. I believe they also added captchas against excessive crawling (perhaps via Tor only).