4 ms·
It is mainly the cost of getting nodes from EC2 at that point. It becomes hard to get a huge number of i2.8xl instances. Spark runs fine on thousands of nodes.
by rxin 12y ago
It is mainly the cost of getting nodes from EC2 at that point. It becomes hard to get a huge number of i2.8xl instances.
Spark runs fine on thousands of nodes.