3 ms·
Ask HN: Do you scrape?
Do you scrape anything?
If so, what and for what purpose?
What software or service do you prefer?
- ashitlerferad 11y agoAbsolutely, the web is such a horrid place that scraping is a necessity.
- tehwebguy 11y agoYou scrape as an alternative to browsing in some cases? That's interesting, is it to avoid advertising / tracking / poor UI / something else?
- pink_dinner 11y agoWrite your own. For me, it's the most efficient (and you will learn a lot).
- snehesht 11y agoWriting your own may take some time but it's definitely worth it. I use Python + AsyncIO + lxml. If you're are new to this and don't have time to learn new things, I suggest you try import.io
- herbst 11y agoI love Nokogiri. It is a ruby library for parsing XML/HTML