3 ms·
Are you sure you're not thinking of flume? I think flume is different from the original map-reduce.
by calderwoodra 3y ago
Are you sure you're not thinking of flume? I think flume is different from the original map-reduce.
- dekhn 3y agoYes, I'm not thinking of Flume. When I worked on sibyl we were in the middle of converting most of the data pipelines (which are now externalized in TFX) to Flume, but the core learner, along with many other prod jobs at google, still used MapReduce. But, by that time, the majority of google developers were using Flume instead of MR. Certainly even in 2013 MR was definitely being used; I launched a product at that time that ran an MR because we couldn't get similar performance out of Flume yet.