3 ms·
Was this change ever logged or noted some way? Or did it just show up one day?
by MichaelZuo 2y ago
Was this change ever logged or noted some way? Or did it just show up one day?
- philipkglass 2y agoIf it ever returned time-sorted results without limit, that was long in the past. It has truncated results to one year for the last several years I have used Scholar.
- crazygringo 2y agoIt seems so intentionally "broken", I can only guess it is to prevent scraping? Since searching for generic-ish search terms and sorting by date is a common scraping strategy. Still, you'd think they'd do a cutoff of e.g. 500 or 1,000 items rather than filter by the past year. So I can't help but wonder if it's a contractual limitation insisted on by publishers? Since the publishers also don't want all their papers being spidered via Scholar? It feels kind of like a limitation a lawyer came up with.
- eesmith 2y agoUnlikely, since the easy work-around for scrapers is to search by date range and grab things that way. That's what I do now manually.
- asdff 2y agopubmed is literally built for academic scraping. It even has a command line interface to access it. If publishers were worried about scraping they'd target that, but they don't. In fact when papers go on pubmed after a year they are rehosted by pubmed central and made freely available to anyone in the world.