2 ms·
The GFS paper 1. showed that software can overcome faults in the hardware and 2. formed the storage basis for Google MapReduce. From there, Apache Hadoop, the
by jll29 4y ago
The GFS paper 1. showed that software can overcome faults in the hardware and 2. formed the storage basis for Google MapReduce.
From there, Apache Hadoop, the open source clone by the Nutch team took off, which in turn led to Zacharia's Spark (now Apache Spark), which provided the RDD abstraction to remove the batch-only limitations of Hadoop, thus enabling distributed iterative and graph methods at scale.