3 ms·
>> It's a little strange to go back to map reduce when presumably YARN is available and tez or spark could be used. YARN just refactored the scheduling / resou
by TallGuyShort 9y ago
>> It's a little strange to go back to map reduce when presumably YARN is available and tez or spark could be used.
YARN just refactored the scheduling / resource management out of MapReduce. Hadoop 2+ still uses the term "MapReduce" for that particular application, and that application runs on a YARN cluster, just like Tez (I think) and Spark can. I don't see anything to indicate they're NOT using YARN.
- XR0CSWV3h3kZWg 9y agoYep, if they are running hadoop 2 then they have YARN and they can use MR, Tez or Spark.
- agibsonccc 9y agoThat happened years ago. I haven't seen a hadoop 1 in the wild in a long time now. When most people think of "hadoop" now, it's more about the ecosystem of "HDFS + some addons like spark"
- TallGuyShort 9y agoI'm just saying that when the article says "MapReduce", it in no way limits their workload to Hadoop 1 or 0.20.x, as OP seem to have thought.