3 ms·
You can download them from google: https://bigquery.cloud.google.com/table/fh-bigquery:reddit_comments.all?pli=1 https://bigquery.cloud.google.com/table/fh-big
by benibela 7y ago
You can download them from google:
https://bigquery.cloud.google.com/table/fh-bigquery:reddit_comments.all?pli=1 https://bigquery.cloud.google.com/table/fh-bigquery:reddit_c...
Run an SQL over all comments of everyone
edit: so only comments till october. 6 months old, that is when they become archived. Guess google has only the archived comments.
- behindsight 7y agoYou can also download them from their original mirror at pushshift[1] PS: that BQ you linked is maintained by fhoffa[2] 1: https://files.pushshift.io/reddit/ https://files.pushshift.io/reddit/ 2: https://news.ycombinator.com/user?id=fhoffa https://news.ycombinator.com/user?id=fhoffa
- benibela 7y agoOriginal mirror? But the BQ has 2019_10 while the pushshift has only up 2019-09
- behindsight 7y agoApologies let me clarify: Pushshift has a live api that mirrors reddit which you can use to compile a more recent dataset[0]. The uploader of that BQ has cited Pushshift as their source[1]. PS: In the next couple of days the batched archive data for Q4 of 2019 as well as Q1 of 2020 will be available[2] 0: https://github.com/pushshift/api https://github.com/pushshift/api 1: https://www.reddit.com/r/bigquery/comments/fcyu4m/extended_on_reddit_what_proportion_of_all_upvotes/fjdup6t/ https://www.reddit.com/r/bigquery/comments/fcyu4m/extended_o... 2: https://www.reddit.com/r/pushshift/comments/fuoe2d/september_december_submissions_will_be_available/ https://www.reddit.com/r/pushshift/comments/fuoe2d/september...