try YCSB benchmark : https://github.com/brianfrankcooper/YCSB https://github.com/brianfrankcooper/YCSB dfsio: https://support.gopivotal.com/hc/en-us/articles/2

try YCSB benchmark : https://github.com/brianfrankcooper/YCSB https://github.com/brianfrankcooper/YCSB dfsio: https://support.gopivotal.com/hc/en-us/articles/200864057-Running-DFSIO-mapreduce-benchmark-test https://support.gopivotal.com/hc/en-us/articles/200864057-Ru... note: EBS IO performance used to be abysmal, especially for cheaper instances, use storage which comes native with the EC2 instances vs network-based, see AWS FAQ: http://www.datadoghq.com/wp-content/uploads/2013/07/top_5_aws_ec2_performance_problems_ebook.pdf http://www.datadoghq.com/wp-content/uploads/2013/07/top_5_aw... if you're interested in scalable in-memory computing (online vs batch) try Storm: http://storm.incubator.apache.org/ http://storm.incubator.apache.org/ Spark: http://spark.apache.org/ http://spark.apache.org/ Phoenix: http://phoenix.incubator.apache.org/ http://phoenix.incubator.apache.org/