7 ms·
I wonder how long it'll take for scraping to make a comeback. I feel like we've become used to APIs being the only integration options. When API restrictions be
by quotemstr 7y ago
I wonder how long it'll take for scraping to make a comeback. I feel like we've become used to APIs being the only integration options. When API restrictions become too burdensome, however, I expect people to recall that other access options exist.
- johnwheeler 7y agoFunny thing - there’s a very successful bank account aggregation API company called Yodlee that gets the majority of it’s bank data through scraping your account given that account’s username and password.
- londons_explore 7y agoGoogle webservices make scraping pretty easy. They send all data back in a rest-like API, protobuf encoded. All you need to do is guess the protobuf schema. Since protobuf is backwards compatible, you can be fairly sure your scraping won't break arbitrary either. In many cases, they send back more data than is shown in the webUI too.