Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
kanzure
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
81 ms
·
721.
▲
by
kanzure
14y ago
comments: http://news.ycombinator.com/item?id=5057835
722.
▲
by
kanzure
14y ago
> It's my understanding that universities pay significant amounts for site > licenses and that general public purchases do not subsidize that access. Yeah, I am pretty baffled with how non-institutional users are reque
723.
▲
by
kanzure
14y ago
I don't see any evidence either way for whether or not his "keepgrabbing" python soup only grabbed public domain articles. At the very least, I imagine it touched the landing pages for each article to get the pdf link, where it would also h
724.
▲
by
kanzure
14y ago
I am trying to collect small hacks like this that are popping up. I know everyone writes scrapers, but hardly anyone talks about it. But maybe talking about it would be helpful so that we can figure out what goes right and what goes wrong:
725.
▲
by
kanzure
14y ago
https://groups.google.com/group/science-liberation-front
726.
▲
by
kanzure
14y ago
They are starting to use a membership fee system as of this month (January 2013). Just a few choice quotes: "The annual budget for arXiv is $400,000 for 2010." [1] Total operating costs for 2013 are projected to be $837,000.[2] "It has been
727.
▲
ArXiv Business Model
(confluence.cornell.edu)
8 points
by
kanzure
14y ago
|
2 comments
728.
▲
by
kanzure
14y ago
I see that you have a download link, but it doesn't work. $ wget -O file.pdf http://www.academia.edu/attachments/27796552/download_file --2013-01-13 12:55:35-- http://www.academia.edu/attachments/27796552/download_file Resol
729.
▲
by
kanzure
14y ago
> Run a Tor exit node in an academic network that is > blessed by JSTOR, Springer, etc. I like this plan. But what should the school do when Elsevier cuts them off? Maybe we need moles in the publishing companies thems
730.
▲
by
kanzure
14y ago
Wow, academia.edu only shows images of pages of pdfs, instead of giving you the actual pdf? I didn't know that. That's absolutely unacceptable .. if true- and a later comment shows that this is only half-true. So it's not as completely ridi
731.
▲
by
kanzure
14y ago
> There are actually underground websites for searching > paywalled journals through proxies. Can you hook a brother up?
732.
▲
by
kanzure
14y ago
> How do you return something that was downloaded? There was a public gesture where his attorney physically handed over some hard drives. Then the US Secret Service allowed him to access it once in a while to build his defense
733.
▲
by
kanzure
14y ago
> to be distributed among current college students I've been thinking about a mobile proxy app that students run on their phones, and a server that distributes tasks. The app would HTTP itself to the server and ask for a task,
734.
▲
by
kanzure
14y ago
Holy crap, what? ---- Information is power. But like all power, there are those who want to keep it for themselves. The world’s entire scientific and cultural heritage, published over centuries in books and journals, is increasingly being d
735.
▲
by
kanzure
14y ago
Science is one of the greatest achievements of mankind. In fact, it's right up there next to the internet and the concept of the library. or books. I can't help but feel like an alien to this world when I can't access papers. I think we can
736.
▲
by
kanzure
14y ago
I originally found that in one of the legal docs, here: http://archive.org/search.php?query=subject%3A%22Aaron+Swart...
737.
▲
Aaron Swartz: Guerilla Open Access Manifesto
(pastebin.com)
179 points
by
kanzure
14y ago
|
8 comments
738.
▲
by
kanzure
14y ago
Not quite, it's just the Philosophical Transactions of the Royal Society. It's a good start, I guess. http://news.ycombinator.com/item?id=2789709 (lots of comments) > This archive contains 18,592 scientific publications total
739.
▲
by
kanzure
14y ago
Right. Someone released the Philosophical Transactions of the Royal Society (originally held only by JSTOR), which is a start: http://news.ycombinator.com/item?id=2789709 > This archive contains 18,592 scientific publications
740.
▲
by
kanzure
14y ago
> Or anyone who is a patron of a university library system, > which in this day and age means anyone who has been given > access to a university network. Not everyone is in a university, in fact there are billi
741.
▲
by
kanzure
14y ago
> Anyone can sign up for a JSTOR account and read up to > three articles for free every two weeks. Calling that free is seriously insulting to aaronsw.
742.
▲
by
kanzure
14y ago
Just the other day I emailed aaronsw asking about OCLC and his plans to topple it. His response wasn't very optimistic. I should have asked him a more humane question, like "sup" or "how's it hanging". For whatever reason, I keep bumping in
743.
▲
by
kanzure
14y ago
the most advanced human knowledge is a collection of PDFs that are not good for anything except printing and forgetting Yep, and we have no backup of science. If science is so important, why is there no backup of all these files? How impo
744.
▲
by
kanzure
14y ago
So you're viglink or gumroad but with images?
745.
▲
by
kanzure
14y ago
> Actually paperclip doesn't rely on HTTParty I thought it uses aws-sdk? Looks like it doesn't. Huh.. https://github.com/aws/aws-sdk-ruby/blob/master/Gemfile#L17
746.
▲
by
kanzure
14y ago
Oh hmm, I guess that's a good thing to point out. Yes, the multi_xml gem has not been upgraded, and the listed dependencies for httparty and mailchimp haven't changed either.
747.
▲
by
kanzure
14y ago
Yo dawgs, the mailchimp, aws-sdk, jenkins and twilio gems use HTTParty which uses multi_xml. You should look into this.
748.
▲
by
kanzure
14y ago
It should probably use symbolhound.com instead, which does exact symbol queries on stackoverflow content. Google, alas, thinks we are all terrible people for wanting our precious bytes.
749.
▲
by
kanzure
14y ago
> freely available api for your service, which exposes PDF links I configured an API like this just the other day (zotero's translation-server). I wanted an IRC bot to fetch pdfs. I call him paperbot. The big problem was figur
750.
▲
by
kanzure
14y ago
I imagine it would look like raw data, probably json. Then you can do the mashups play, etc. I think Elsevier has tried some of that to some success (look at their API docs). Mendeley is also trying this approach and has done fairly well so
More ›