I'm going to be refining and updating the tech behind it (it's quite old) but I wrote a little more here, at least for the Twitter scraping: http://rawkes.com/a

I'm going to be refining and updating the tech behind it (it's quite old) but I wrote a little more here, at least for the Twitter scraping: http://rawkes.com/articles/how-i-scraped-and-stored-over-3-million-tweets http://rawkes.com/articles/how-i-scraped-and-stored-over-3-m... As for the sentiment analysis… I'm unable to release the data-set as it's owned by a university in Florida and only available to students. A quick Google on sentiment analysis, or 'Affective Norms for English Words' will come up with useful things. :)