I guess that is the reason why you really don't want to spin off a lot EC2 instances for large jobs. Instead, you may use the MapReduce framework s.t. you can e

I guess that is the reason why you really don't want to spin off a lot EC2 instances for large jobs. Instead, you may use the MapReduce framework s.t. you can exploit the data locality. And of course, MapReduce only solves a small portion of parallel problems.