3 ms·

Are there any actually free/libre recommendation data sets? All that I can find, including the ones used by Surprise (MovieLens, etc.), look to be under restric

by abetusk 10y ago

Are there any actually free/libre recommendation data sets? All that I can find, including the ones used by Surprise (MovieLens, etc.), look to be under restrictive licenses.

danso 10y ago
My first instinct was to point you to a colleague's page, Justin Grimmer, who does analysis of free-form text such as Congressional press releases (and other statements). I swear he had direct links to zip files of this bulk text data but can't find them on a quick glance. Here's his research listing just to give an idea of what he's able to analyze from this public data: http://www.justingrimmer.org/research.html http://www.justingrimmer.org/research.html As for why there aren't newer, or at least more of a variety of public datasets as canonical as the iris, diamond, Titanic survivors, MovieLens, etc...I'm baffled too (being a recent newcomer to academia). If scraping is difficult for you, Socrata has made finding data exponentially easier than what it was a few years ago. Here's a great place to start: http://www.opendatanetwork.com/ http://www.opendatanetwork.com/
- abetusk 10y ago
  I can program so scraping is pretty easy. Finding data sets that aren't restricted is the hard part. Thanks for the links.
  - danso 10y ago
    If you have an interest in U.S. politics, check out the github/unitedstates repo, which is full of data and assets, particularly about legislators and their votes: https://github.com/unitedstates https://github.com/unitedstates Sunlight Labs, the tech arm of the Sunlight Foundation, is sadly closing down, but they passed many of their projects to ProPublica. Here's a writeup of that to give an idea of what the projects contained (in terms of data): https://www.propublica.org/nerds/item/sunlight-labs-takeover-update https://www.propublica.org/nerds/item/sunlight-labs-takeover... Just in case you don't care about the U.S., it must be mentioned that the UK has the best country-level data repository: https://data.gov.uk/ https://data.gov.uk/

by abetusk 10y ago

Are there any actually free/libre recommendation data sets? All that I can find, including the ones used by Surprise (MovieLens, etc.), look to be under restrictive licenses.

danso 10y ago

My first instinct was to point you to a colleague's page, Justin Grimmer, who does analysis of free-form text such as Congressional press releases (and other statements). I swear he had direct links to zip files of this bulk text data but can't find them on a quick glance. Here's his research listing just to give an idea of what he's able to analyze from this public data: http://www.justingrimmer.org/research.html http://www.justingrimmer.org/research.html As for why there aren't newer, or at least more of a variety of public datasets as canonical as the iris, diamond, Titanic survivors, MovieLens, etc...I'm baffled too (being a recent newcomer to academia). If scraping is difficult for you, Socrata has made finding data exponentially easier than what it was a few years ago. Here's a great place to start: http://www.opendatanetwork.com/ http://www.opendatanetwork.com/

abetusk 10y ago
I can program so scraping is pretty easy. Finding data sets that aren't restricted is the hard part. Thanks for the links.
- danso 10y ago
  If you have an interest in U.S. politics, check out the github/unitedstates repo, which is full of data and assets, particularly about legislators and their votes: https://github.com/unitedstates https://github.com/unitedstates Sunlight Labs, the tech arm of the Sunlight Foundation, is sadly closing down, but they passed many of their projects to ProPublica. Here's a writeup of that to give an idea of what the projects contained (in terms of data): https://www.propublica.org/nerds/item/sunlight-labs-takeover-update https://www.propublica.org/nerds/item/sunlight-labs-takeover... Just in case you don't care about the U.S., it must be mentioned that the UK has the best country-level data repository: https://data.gov.uk/ https://data.gov.uk/