6 ms·
Google Scholar definitely and intentionally offers no API. I don't see this lasting long...
by jrochkind1 9y ago
Google Scholar definitely and intentionally offers no API.
I don't see this lasting long...
- mchannon 9y agogoogle.com/scholar doesn’t work for you?
- vha32oiwe 9y agoThey called out API specifically Not UI
- wyldfire 9y agoThe issue is regarding: this service (Sci-Bay) depends on Google Scholar, yet there's no public API for Google Scholar that it could leverage. If it's scraping Google Scholar results, then it's likely a ToS violation and unlikely to last long.
- userbinator 9y agoHow much of a "ToS violation" is SciHub, and how long has it lasted? "If there's a will, there's a way" comes to mind. Also, the fact that all web pages technically already have an "API" --- it's called "HTTP" ;-) Good for them, I say.
- gpm 9y agoAt a glance it looks like it's really just a proxy, that was limited to scholar.google.com and mutates the page slightly (adds a header, sci-hub links). Does google generally block proxy servers?
- jrochkind1 9y agoI don't know if they generally do, but I'm sure they can/will if they want to.
- Spivak 9y agoThey don't block startpage and they've been around for a while.
- Vinnl 9y agoI'd imagine that would be quite hard: many university libraries have their own proxies which make sure that visitors to the library are able to access the content that the library has paid for, and often modifies Google Scholar (with their cooperation, I believe) to list links to accessible versions of the content next to search results.
- danielecook 9y agoWhy is that? Seems like it would be really beneficial to the scientific community.
- shakna 9y agoThey likely don't have legal permission to allow for third-party access to the data they provide.
- matheusmoreira 9y agoThe page's HTML is the API. It's pretty easy to download a web page, parse the HTML and then extract specific bits of information from it. The browser does the same thing on the user's behalf, which is why it is called the user agent.
- hrasyid 9y agoAn API is a contract. HTML can be tweaked and become incompatible with your parser at the developer's whim.
- gkya 9y agoOh luckily major APIs never change. /s
- hrasyid 9y agoNot as easily as an HTML page
- matheusmoreira 9y agoThat just means your code must be maintained. You can verify that the HTML has a given structure and log a failure if it doesn't.
- amelius 9y agoUse Deep Learning to circumvent that.
- jrochkind1 9y agoHome page currently says: > See you later > Too much attention is a bad thing, Sci-Bay decides to stop service for a while. Sorry. Apparently I was not wrong. This could be developed as a browser plugin that would be much harder or almost impossible for Google to prevent. Well, a Firefox browser plugin, a Chrome browser plugin presumably they wouldn't allow.