4 ms·

I really want to get my full commenting history from this, but the download is enormous. Anyone know how I could go about this with cloud services?

stuck_in_the_ma 11y ago
Hey there! I'm the one that uploaded the original dataset. I'm creating API endpoints that will easily allow you to do this. It should be completed in 1-2 weeks.
- stuck_in_the_ma 11y ago
  I just realized my username on here is ... oh god.
- x0 11y ago
  Beautiful!
ytdht 11y ago
here it is, only selected the body of your comments though, out of 4005 comments... http://s000.tinyupload.com/?file_id=09238386475544637092 http://s000.tinyupload.com/?file_id=09238386475544637092 here is the query that I used: SELECT author, body FROM [fh-bigquery:reddit_comments.2007], [fh-bigquery:reddit_comments.2008], [fh-bigquery:reddit_comments.2009], [fh-bigquery:reddit_comments.2010], [fh-bigquery:reddit_comments.2011], [fh-bigquery:reddit_comments.2012], [fh-bigquery:reddit_comments.2013], [fh-bigquery:reddit_comments.2014], [fh-bigquery:reddit_comments.2015_01], [fh-bigquery:reddit_comments.2015_02], [fh-bigquery:reddit_comments.2015_03], [fh-bigquery:reddit_comments.2015_04], [fh-bigquery:reddit_comments.2015_05] WHERE author = 'Houshalter' this is where you can run another query: https://bigquery.cloud.google.com/table/fh-bigquery:reddit_comments.2015_05 https://bigquery.cloud.google.com/table/fh-bigquery:reddit_c... I did the same for my account and some comments are definitely missing... The first one that I cross-referenced is missing (5 month old and 1 point comment). But I have other comments with only 1 point and also 5 months old and those are there.
- Houshalter 11y ago
  Thank you so much! I'd like to try it myself, but your link redirects me to some getting started page. Any idea why some comments are missing? I haven't checked to see if they are all there, as far as I know they are. I know that any in closed subreddits or comments that were removed by mods might be missing. But if you can access the comment's permalink without being signed in, then it should be in your data.
  - ytdht 11y ago
    No problem. I believe that you need to create a project first, for the page to work. You were right and that comment has been deleted for some reason.

stuck_in_the_ma 11y ago

Hey there! I'm the one that uploaded the original dataset. I'm creating API endpoints that will easily allow you to do this. It should be completed in 1-2 weeks.

stuck_in_the_ma 11y ago
I just realized my username on here is ... oh god.
x0 11y ago
Beautiful!

ytdht 11y ago

here it is, only selected the body of your comments though, out of 4005 comments... http://s000.tinyupload.com/?file_id=09238386475544637092 http://s000.tinyupload.com/?file_id=09238386475544637092 here is the query that I used: SELECT author, body FROM [fh-bigquery:reddit_comments.2007], [fh-bigquery:reddit_comments.2008], [fh-bigquery:reddit_comments.2009], [fh-bigquery:reddit_comments.2010], [fh-bigquery:reddit_comments.2011], [fh-bigquery:reddit_comments.2012], [fh-bigquery:reddit_comments.2013], [fh-bigquery:reddit_comments.2014], [fh-bigquery:reddit_comments.2015_01], [fh-bigquery:reddit_comments.2015_02], [fh-bigquery:reddit_comments.2015_03], [fh-bigquery:reddit_comments.2015_04], [fh-bigquery:reddit_comments.2015_05] WHERE author = 'Houshalter' this is where you can run another query: https://bigquery.cloud.google.com/table/fh-bigquery:reddit_comments.2015_05 https://bigquery.cloud.google.com/table/fh-bigquery:reddit_c... I did the same for my account and some comments are definitely missing... The first one that I cross-referenced is missing (5 month old and 1 point comment). But I have other comments with only 1 point and also 5 months old and those are there.

Houshalter 11y ago
Thank you so much! I'd like to try it myself, but your link redirects me to some getting started page. Any idea why some comments are missing? I haven't checked to see if they are all there, as far as I know they are. I know that any in closed subreddits or comments that were removed by mods might be missing. But if you can access the comment's permalink without being signed in, then it should be in your data.
- ytdht 11y ago
  No problem. I believe that you need to create a project first, for the page to work. You were right and that comment has been deleted for some reason.