3 ms·
Depends on your use case. If you just need specific data from a known location, build a scraper. If you’re looking to index as much data as possible, build a c
by bransonf 7y ago
Depends on your use case. If you just need specific data from a known location, build a scraper.
If you’re looking to index as much data as possible, build a crawler.
The complexity of a crawler is significantly more than a scraper, so it’s not always the right choice.