7 ms·
Blocking scraping is the norm for Google, for instance the Public Youtube API allows you to view a grand total of 3 or so videos per key per day before it start
by throwaway2048 7y ago
Blocking scraping is the norm for Google, for instance the Public Youtube API allows you to view a grand total of 3 or so videos per key per day before it starts blocking you.
Google has basically got as bad as twitter in terms of giving a big middle finger to third party devs, but they have been smart enough to maintain a completely useless public/free tier for most things.
- acgan 7y agoThat makes sense. I'd hope that Scholar would be different, though. A piece on how a researcher spent a summer filling out CAPTCHAs / scraping: https://www.nature.com/articles/d41586-018-04190-5 https://www.nature.com/articles/d41586-018-04190-5
- buboard 7y agoScholar should be different, considering that they are the only ones in the world who are given access to everything