3 ms·
I might be missing something, but could you explain why?
by jaflo 8y ago
I might be missing something, but could you explain why?
- scandox 8y agoBecause 99% of scraping is parsing that column. At least that’s been my experience.
- nkozyra 8y agoScraping is literally just the successful acquisition of content. You're getting into data parsing. Almost nobody scrapes data without processing, parsing and normalizing it, but scraping is getting the data in the first place. Scraping isn't easy at scale, though. You have to distribute your crawlers, adhere to TOS (in theory) and avoid getting blocked. It's simple at small scale, though. I don't know about the utility of this service, though. It handles the less interesting part of data acquisition and processing. I also agree with other comments that most scraping use cases are targeted and small in scope.