3 ms·
MapReduce: A Flexible Data Processing Tool (AKA Dean and Ghemawat strike back)
- sanj 17y agoGiven the factor of an 80-fold difference in this record-parsing benchmark, we suspect the absolute numbers for the Hadoop benchmarks in the comparison paper are inflated... Whoa! Those are some serious fighting words!
- runevault 17y agoWhole article could be argued to be fighting words, considering they basically point out flawed assertions in the comparison paper" over and over again. Though catching an 80-fold difference is pretty ridiculous.
- brown9-2 17y agoLooks like the author's of the "comparison paper" have a new paper out (the byline says Jan 1 2010) titled "MapReduce and Parallel DBMSs: Friends or Foes?" which seems to take a different approach at characterizing Map/Reduce, but unfortunately the contents are only available for premium members. http://cacm.acm.org/magazines/2010/1/55743-mapreduce-and-parallel-dbmss-friends-or-foes/fulltext http://cacm.acm.org/magazines/2010/1/55743-mapreduce-and-par... Parallel DBMSs excel at efficient querying of large data sets; MapReduce-style systems excel at complex analytics and ETL tasks. Neither is good at what the other does well. Hence, the two technologies are complementary.
- ypavan 17y agoDuplicate entry: http://news.ycombinator.com/item?id=1018454 http://news.ycombinator.com/item?id=1018454 The submitter added the known "#' at the end of the linked URL to resubmit again.
- bbgm 17y agoSorry bout that. Didn't notice the additional character.