3 ms·
Google webservices make scraping pretty easy. They send all data back in a rest-like API, protobuf encoded. All you need to do is guess the protobuf schema.
by londons_explore 7y ago
Google webservices make scraping pretty easy. They send all data back in a rest-like API, protobuf encoded.
All you need to do is guess the protobuf schema. Since protobuf is backwards compatible, you can be fairly sure your scraping won't break arbitrary either.
In many cases, they send back more data than is shown in the webUI too.