4 ms·

Didn't set the number of threads for Spark to use. You should oversubscribe. This is probably the biggest misstep.

• szilard 11y ago
  I set number of partitions = number of cores, so should be good.