3 ms·
Scraping 1000 results a day is really not any kind of web scraping scale. There’s barely any of the same considerations of systems that scrape tens millions a d
by ed25519FUUU 5y ago
Scraping 1000 results a day is really not any kind of web scraping scale. There’s barely any of the same considerations of systems that scrape tens millions a day.
You could easily store those kinds of results in a local DB for offline processing and resuming.
- cushychicken 5y agoEven at my cutesy, boutique scale, there is plenty there to obsess about. XD