> Big data is about I/O not CPU > I’m a C++ veteran btw and understand the point but big data is about how to process petabytes of I/O not how to consume CPU.

> Big data is about I/O not CPU > I’m a C++ veteran btw and understand the point but big data is about how to process petabytes of I/O not how to consume CPU. I'm not sure this is cut-and-dry. Back when I was working on Spark workloads, there was some interesting research being done on where the bottlenecks were for jobs. I think it turned out for a lot of jobs, infinite disk / network io didn't give as much of an improvement as you'd expect. https://databricks.com/session/making-sense-of-spark-performance https://databricks.com/session/making-sense-of-spark-perform...