3 ms·
Is the code available for this in github? The dataset is 370 GB, i think. What did the author use - postgres/Spark/other?
by jamesblonde 11y ago
Is the code available for this in github? The dataset is 370 GB, i think. What did the author use - postgres/Spark/other?
- skeletonjelly 11y agoBigQuery, it's mentioned in the linked article. http://bigquery.cloud.google.com/table/fh-bigquery:reddit_comments.2015_05 http://bigquery.cloud.google.com/table/fh-bigquery:reddit_co... Probably this dataset which is updated periodically