4 ms·
How do you handle scraping the products, do you just fetch all new products once per day? Or do you fetch them all in real time as the user searches
by Exuma 9y ago
How do you handle scraping the products, do you just fetch all new products once per day? Or do you fetch them all in real time as the user searches
- wriggler 9y agoEverything is done with real time calls to the eBay API. eBay's catalogue is too large to make it realistic to fetch it as a whole and, anyway, as far as I remember they don't offer a data dump (it's been a long time since I checked). Luckily, eBay's API is very fast, but I also worked hard to keep the total response time of my code within a reasonable range.
- Exuma 9y agoAh interesting, that makes sense. Thanks