13 ms·

>>I think there will always be a place for the Beowulf type clusters and MPI-CH and OpenMP You use OpenMP to scale your Hadoop jobs, see http://www.cray.com/Pr

• dekhn 13y ago
  In general, there's nothing preventing you from using threading in MapReduce. For example, your Map() function can act as a capture buffer (calls to map just save data into a thread safe queue), you can have multiple worker threads reading items from that queue, communicatijng, and finally, a thread that calls Flush() on the results of the thread pool/thread queue.