3 ms·
I guess they did not analyze joining two large datasets (I am assuming because M/R would win hands down). Someone more experienced please tell me if I am "think
by fuzzieozzie 11y ago
I guess they did not analyze joining two large datasets (I am assuming because M/R would win hands down). Someone more experienced please tell me if I am "thinking" correctly.
- dalke 11y agoWhat does it mean to "join two large datasets"? I can think of many meanings. What part of the method description in the abstract did you consider yourself too inexperienced to understand?
- EwanToo 11y agoI don't think so, if you're just doing a staight batch job with no sorting, iterative processing, etc, then they'll probably be a very similar speed. If you have to sort one of the datasets first, then Spark will likely be faster, but it all depends on a ton of factors that are task specific.