3 ms·
Complaints like this are the reason companies are reluctant to release public datasets. They don't have any obligation to release data, but they do. It's a gi
by notatoad 10y ago
Complaints like this are the reason companies are reluctant to release public datasets. They don't have any obligation to release data, but they do. It's a gift. If they have to consider "how will this change affect the consumers of our public data releases?" every time they make a change, they're going to stop releasing public datasets.
- minimaxir 10y agoFor clarity, the Reddit datasets are not released by Reddit itself, but scraped through the API. (More context/examples of what I do with the data: http://minimaxir.com/2015/10/reddit-bigquery/ http://minimaxir.com/2015/10/reddit-bigquery/ )
- notatoad 10y agoOkay, but reddit does also release some public data sets: https://github.com/reddit/public-data-sets https://github.com/reddit/public-data-sets
- minimaxir 10y agoAh, right, forgot about those. (Although, those are traffic aggregates and wouldn't be affected by changed in the score ranking)
- erikpukinskis 10y agoAn API is not scraping. Scraping is taking a loosely structure document with no agreed upon interface and extracting data. A relevant comparison would be Craigslist who will use legal force to prevent you using data you scrape off the site.
- vosper 10y agoDoes this mean you (or I if I want to do some analytics on Reddit data) will need to completely rescrape the site after scores are recomputed?
- minimaxir 10y agoIf you wanted to compare raw scores for submissions before the change to those after the changes, yes. Otherwise, it shouldn't matter.
- deleted 10y ago[deleted]