3 ms·
This is mostly another fix of bad design that was added in Reddit's early years, but people have started to notice the aggressive vote fuzzing as it was calibra
by minimaxir 10y ago
This is mostly another fix of bad design that was added in Reddit's early years, but people have started to notice the aggressive vote fuzzing as it was calibrated for a much smaller userbase.
At the least, this will break statistical analysis of Reddit data for awhile since the public datasets will not have their scores updated, which I in particular am not happy about. :p
- notatoad 10y agoComplaints like this are the reason companies are reluctant to release public datasets. They don't have any obligation to release data, but they do. It's a gift. If they have to consider "how will this change affect the consumers of our public data releases?" every time they make a change, they're going to stop releasing public datasets.
- minimaxir 10y agoFor clarity, the Reddit datasets are not released by Reddit itself, but scraped through the API. (More context/examples of what I do with the data: http://minimaxir.com/2015/10/reddit-bigquery/ http://minimaxir.com/2015/10/reddit-bigquery/ )
- notatoad 10y agoOkay, but reddit does also release some public data sets: https://github.com/reddit/public-data-sets https://github.com/reddit/public-data-sets
- minimaxir 10y agoAh, right, forgot about those. (Although, those are traffic aggregates and wouldn't be affected by changed in the score ranking)
- erikpukinskis 10y agoAn API is not scraping. Scraping is taking a loosely structure document with no agreed upon interface and extracting data. A relevant comparison would be Craigslist who will use legal force to prevent you using data you scrape off the site.
- vosper 10y agoDoes this mean you (or I if I want to do some analytics on Reddit data) will need to completely rescrape the site after scores are recomputed?
- minimaxir 10y agoIf you wanted to compare raw scores for submissions before the change to those after the changes, yes. Otherwise, it shouldn't matter.
- deleted 10y ago[deleted]