3 ms·

So can I drill down into the individual tweets or posts? I would find that useful - and would love to get to the firehose for some NLP style analysis. I just d

So can I drill down into the individual tweets or posts? I would find that useful - and would love to get to the firehose for some NLP style analysis. I just don't have the bandwidth to download all of reddit and make it searchable ... EDIT: weirdly searching for "Hacker news" leads to a really odd trend on Twitter - between 2010 and 2013 lots of activity, then a massive drought till 2019 and back up again. Very odd - I cannot think of a cause

anigbrowl 6y ago
As far as Twitter goes, the Twitter streaming importer on Gephi is very powerful, and the software is moderately interoperable; unfortunately the project as a whole is lacking funding/development except for specific modules. You should also look into pushift.io which archives/indexes huge amounts of publicly accessible social media data, and which I think supplies some of the backend infrastructure for this project.