4 ms·

Somewhat related, does anyone know of a good tool to archive one's entire reddit history? I'd like to be able to dump all my comments, saved posts, etc to a fol

Somewhat related, does anyone know of a good tool to archive one's entire reddit history? I'd like to be able to dump all my comments, saved posts, etc to a folder. Even better if I can download whole treads, linked media, etc. Not worried about getting nuked for OP's linked example but I've gotten very interested in building personal archives of any of my online history. As a personal anecdote, earlier this year I went through and (tediously) saved my bungie.net account which contained all my Halo 2, 3, etc online activity history. Funny enough, just a couple of months later Bungie announced that they were shutting down the site, and longtime fans scrambled to save what records they could. Unfortunately the forums were gone by that point, so I lost a lot of my memories there, but today I don't remember how much time I actually spent archiving that data, I remember the memories that come flooding back whenever I look through that data again.

Tenoke 6y ago
>Somewhat related, does anyone know of a good tool to archive one's entire reddit history? I've tried this for nlp training and all the old tools I tried no longer work, and you can't do it via the API either. Your best bet is to scrape it the old fashion way e.g. with Selenium but I am also interested if there's a working tool.
- silicon2401 6y ago
  Bummer; so there is a reddit API, but you really can't use it to just get your saves/comments/etc? I had assumed you could. I guess this'll take more effort than I thought. thanks!
Zren 6y ago
Python has a module called PRAW. https://praw.readthedocs.io/en/latest/getting_started/quick_start.html#common-tasks https://praw.readthedocs.io/en/latest/getting_started/quick_... I wrote a quick script a while back to dump my comments by subreddit to a text file to grep through. There's probably better praw scripts running around. https://gist.github.com/Zren/82befb7bf63e3d9156de1bbd48b0ffef https://gist.github.com/Zren/82befb7bf63e3d9156de1bbd48b0ffe...
tablespoon 6y ago
> Somewhat related, does anyone know of a good tool to archive one's entire reddit history? I'd like to be able to dump all my comments, saved posts, etc to a folder. Even better if I can download whole treads, linked media, etc. Not worried about getting nuked for OP's linked example but I've gotten very interested in building personal archives of any of my online history. I believe https://pushshift.io/ https://pushshift.io/ is purported to be archiving all of it, but after poking around I can't find anything past April 2020 in https://files.pushshift.io/ https://files.pushshift.io/. > As a personal anecdote, earlier this year I went through and (tediously) saved my bungie.net account which contained all my Halo 2, 3, etc online activity history. Funny enough, just a couple of months later Bungie announced that they were shutting down the site, and longtime fans scrambled to save what records they could. Unfortunately the forums were gone by that point, so I lost a lot of my memories there, but today I don't remember how much time I actually spent archiving that data, I remember the memories that come flooding back whenever I look through that data again. IMHO the problem with user account activity archives is that social media is social. I've got archives of my old Facebook activity, and it feels even more incomplete than only hearing one side of a telephone call. What I'd really want is an archive of every thread I've posted in, or even every forum for the dates I was active.
fastball 6y ago
I asked Reddit support for my entire history and they sent to me. Admittedly I lived in Europe at the time so I used GDPR as a club. Then I had them nuke the account.

Tenoke 6y ago

>Somewhat related, does anyone know of a good tool to archive one's entire reddit history? I've tried this for nlp training and all the old tools I tried no longer work, and you can't do it via the API either. Your best bet is to scrape it the old fashion way e.g. with Selenium but I am also interested if there's a working tool.

silicon2401 6y ago
Bummer; so there is a reddit API, but you really can't use it to just get your saves/comments/etc? I had assumed you could. I guess this'll take more effort than I thought. thanks!

Zren 6y ago

Python has a module called PRAW. https://praw.readthedocs.io/en/latest/getting_started/quick_start.html#common-tasks https://praw.readthedocs.io/en/latest/getting_started/quick_... I wrote a quick script a while back to dump my comments by subreddit to a text file to grep through. There's probably better praw scripts running around. https://gist.github.com/Zren/82befb7bf63e3d9156de1bbd48b0ffef https://gist.github.com/Zren/82befb7bf63e3d9156de1bbd48b0ffe...

tablespoon 6y ago

> Somewhat related, does anyone know of a good tool to archive one's entire reddit history? I'd like to be able to dump all my comments, saved posts, etc to a folder. Even better if I can download whole treads, linked media, etc. Not worried about getting nuked for OP's linked example but I've gotten very interested in building personal archives of any of my online history. I believe https://pushshift.io/ https://pushshift.io/ is purported to be archiving all of it, but after poking around I can't find anything past April 2020 in https://files.pushshift.io/ https://files.pushshift.io/. > As a personal anecdote, earlier this year I went through and (tediously) saved my bungie.net account which contained all my Halo 2, 3, etc online activity history. Funny enough, just a couple of months later Bungie announced that they were shutting down the site, and longtime fans scrambled to save what records they could. Unfortunately the forums were gone by that point, so I lost a lot of my memories there, but today I don't remember how much time I actually spent archiving that data, I remember the memories that come flooding back whenever I look through that data again. IMHO the problem with user account activity archives is that social media is social. I've got archives of my old Facebook activity, and it feels even more incomplete than only hearing one side of a telephone call. What I'd really want is an archive of every thread I've posted in, or even every forum for the dates I was active.

fastball 6y ago

I asked Reddit support for my entire history and they sent to me. Admittedly I lived in Europe at the time so I used GDPR as a club. Then I had them nuke the account.