3 ms·
Am I right in thinking MapReduce seems to be going out of fashion somewhat as even Google themselves have moved towards using something they term Millwheel. Wh
by deutronium 12y ago
Am I right in thinking MapReduce seems to be going out of fashion somewhat as even Google themselves have moved towards using something they term Millwheel.
Which is a stream based processing system.
I have seen one paper on a streaming MapReduce solution though.
- bcuccioli 12y agoWow. I worked on Millwheel as a summer intern the summer before last. At the time it was a team of about 11 people. I'm honestly pretty surprised to see this comment as I thought it was just a small internal research project. Have you seen any references to it in the wild other than the Google Research paper?
- deutronium 12y agoOh maybe I'm wrong, I really thought I saw something that said it was used for the index creation. I'm just having a look over the papers I've read. They do definitely seem to have switched from MapReduce though at least - http://www.theregister.co.uk/2010/09/09/google_caffeine_explained/ http://www.theregister.co.uk/2010/09/09/google_caffeine_expl...
- brooksd 12y agoHadoop is busy replacing MapReduce with Yez. MapReduce was a great first implementation but we need something that performs better.