4 ms·
> Spark is orders of magnitude faster than Hadoop, too. A comparison between Spark & Hadoop doesn't make much sense though. Spark is a data-processing engine.
by lars_francke 9y ago
> Spark is orders of magnitude faster than Hadoop, too.
A comparison between Spark & Hadoop doesn't make much sense though.
Spark is a data-processing engine.
Hadoop these days is a data storage & resource management solution (plus MapReduce v2). Spark often runs on top of Hadoop: Hosted by YARN accessing data from HDFS.
- minimaxir 9y agoSpark compares itself to Hadoop in its own marketing: http://spark.apache.org http://spark.apache.org
- rocmcd 9y agoThere's a subtle difference between Hadoop (the platform / ecosystem) and Hadoop MapReduce (tasks that run on Hadoop). It's the latter that is being referenced in the comparison.
- minimaxir 9y agoFair distinction.
- lars_francke 9y agoYes, but that still doesn't make much sense. That particular part of the homepage hasn't been updated in ages and refers to the MR part. As you said: Marketing :)