3 ms·
Is the Comment Corpus still available? I have looked but couldn't see anything obvious (my apologies if I'm being thick here)
by laumars 11y ago
Is the Comment Corpus still available? I have looked but couldn't see anything obvious (my apologies if I'm being thick here)
- tomtoise 11y agoSure, here you go [1] - It unpacks to over 1tb though, hence me considering spinning up another server just for the comments. Might be a good use for my test Hadoop cluster. [1] https://www.reddit.com/r/datasets/comments/3bxlg7/i_have_every_publicly_available_reddit_comment/ https://www.reddit.com/r/datasets/comments/3bxlg7/i_have_eve...
- laumars 11y agoThank you. I'll be unpacking this on a FreeBSD server, so hopefully ZFS's lz4 file system compression will take some of the bite out of that 1TB file.