4 ms·
Is MapReduce faster for any cases? A quick glance at the paper seems to suggest that Spark is always at least as good or better than traditional MR. Should I
by econner 11y ago
Is MapReduce faster for any cases? A quick glance at the paper seems to suggest that Spark is always at least as good or better than traditional MR.
Should I ever use traditional MR over Spark?
- bpodgursky 11y agoYou didn't even try to make it through the abstract... > An exception to this is the Sort workload, for which MapReduce is 2 x faster than Spark. We show that MapReduce’s execution model is more efficient for shuffling data than Spark, thus making Sort run faster on MapRe- duce
- falaki 11y agoNote that you can change Spark's aggregation algorithm to sort-based with a configuration.
- eranation 11y agoDidn't spark win the world record on sorting recently? http://spark.apache.org/news/spark-wins-daytona-gray-sort-100tb-benchmark.html http://spark.apache.org/news/spark-wins-daytona-gray-sort-10...