3 ms·
Can you provide an example or two of a project that involved web scraping? (without divulging client info) I can see how it could be used for price scraping in
by deskamess 11y ago
Can you provide an example or two of a project that involved web scraping? (without divulging client info) I can see how it could be used for price scraping in web retail, but am drawing a blank in other industries.
- TheLogothete 11y agoText analytics, for one.
- mtmail 11y agoAddress parsing from a large web corpus https://github.com/openvenues/libpostal https://github.com/openvenues/libpostal The author uses http://commoncrawl.org/ http://commoncrawl.org/ data, 250TB/3.6b URL and a 100 machine cluster of 8-core machines.