2 ms·
Loading from data sources and doing SQL in ram is very much not the definition of Map Reduce.
by zaphar 6y ago
Loading from data sources and doing SQL in ram is very much not the definition of Map Reduce.
- cmckn 6y agoI don't think it's a crazy comparison, but AFAIK Presto doesn't have a shuffle stage, which is fundamental in traditional MapReduce. They're both distributed computations, that's the comparison I would make. Edit: thinking about it more, how could Presto accomplish joins and other SQL operations without a shuffle? Seems very similar to Spark SQL, which is just syntactic sugar for multi-stage MapReduces.
- WookieRushing 6y agoPresto can do shuffles when needed. But it has a smaller max size shuffle than Spark typically because everything has to stay in RAM