3 ms·
As a newbie, I see a lot of articles about scraping. Why is that so interesting?
by kim0 6y ago
As a newbie, I see a lot of articles about scraping. Why is that so interesting?
- captn3m0 6y agoFrom my experience, any business beyond a certain size ends up requiring scraping to get access to some data that is not published cleanly or available programmatically. It is also one of the common gateways to programming - and hence gets written more about I guess?
- whatsmyusername 6y ago"I want piece of information from page programatically but there's no API." Common ask, especially in anything dealing with secondary markets (card balances, information on sales, shoe drops, etc) API will be much faster, but there's a place for this. This is also common when talking to IVR systems (ex. I want a card balance, have some code call the phone number on the card, walk through the phone tree, and use voice reg to get the number)
- paulryanrogers 6y agoAPIs may also present the data differently, not have all the data, require payment, or have much lower rate limits than a browser solution. (Disclosure: work at a SAAS that does both and have done some for personal projects.)