3 ms·
If you're using EBS for shuffle/source data you've already behind. If you can afford it you should be using the host NVME drives or FSX and relying on Spark to
by threeseed 2y ago
If you're using EBS for shuffle/source data you've already behind.
If you can afford it you should be using the host NVME drives or FSX and relying on Spark to handle outages. The difference in performance will be orders of magnitude different.
And in this case you won't have the ability to store 64TB. The average max is 2TB.