I would break the problem up into capture, processing and visualization. For capture something I would look at using an Apache Kafka cluster. For processing eit

I would break the problem up into capture, processing and visualization. For capture something I would look at using an Apache Kafka cluster. For processing either Spark or Storm or maybe even Samza (although i haven't used it) seem like goos options. Spark probably has the best community but Storm has been around for several years now. For visualization i'm leaning towards something like React with Flux and then D3/Chart libraries. Deploy on EC2 because they seem to offer the best availability in town (i've used several providers and they have been the best by far) Use Ansible to automate the infrastructure and away you go. Not sure whether you need to store the time series data but you could look at ElasticSearch or Cassandra (columnar database), which have great performance. Maybe even Crate, which also builds on ES. The size and frequency of the data will dictate the best store. Here is a great list of open source and commercial resources all in one place http://www.bigdata-careers.com/?page_id=99 http://www.bigdata-careers.com/?page_id=99