4 ms·
Is it going away?
by ericmcer 3y ago
Is it going away?
- CameronNemo 3y agoAIUI changes to reddit's API have made Pushshift unsustainable. Edit: see here for the full details, from the reddit admins' POV: https://old.reddit.com/r/modnews/comments/134tjpe/reddit_data_api_update_changes_to_pushshift_access/ https://old.reddit.com/r/modnews/comments/134tjpe/reddit_dat...
- sodality2 3y agoThose changes haven't been put into effect yet, though. It's "coming".
- ericmcer 3y agonuts, I have a little app that relies on it. It is still working atm and returning results from a few seconds ago but that sucks. I was also always baffled how pushshift API is so superior to the Reddit API. AFAIK it is running for ~$1k/mo. Locking down APIs like this could lead to way more scrapers which is expensive for everyone involved. I guess the number of people who know how to hit an API endpoint is way higher than the number who can setup a Selenium type scraper that runs JS and circumvents protections.
- nanidin 3y agoYes, it is no longer available from pushshift (presumably due to pressure from Reddit.) The historical data is now only available via torrent.
- ranting-moth 3y agoLink?
- nanidin 3y agoThe torrent is the submitted link for this post.
- r721 3y agohttps://old.reddit.com/r/pushshift/comments/13mhuzq/api_has_been_taken_down/ https://old.reddit.com/r/pushshift/comments/13mhuzq/api_has_...