4 ms·
Hadoop is a platform for traversing very large data sets. It is not really for "number crunching." One can use any language for the map/reduce pieces of Hadoo
by kingkongrevenge 17y ago
Hadoop is a platform for traversing very large data sets. It is not really for "number crunching." One can use any language for the map/reduce pieces of Hadoop.
- rjurney 17y agoActually, plenty of guys use Hadoop for CPU bound problems. And the fastest way to use it this way is Java, which is what the number crunching users of Hadoop use. Which is to say that the emerging big data compute platform is Java. Which is to say that you're wrong.
- kingkongrevenge 17y agoHadoop is not "for CPU bound problems." It's for huge data. There are much better frameworks for the problem of splitting a parallelizable computation across machines. Nobody would use Hadoop just for that. Why would Java be the fastest way to do computations with Hadoop? You can use many languages for the map/reduce pieces. The fastest language would be fastest language, not necessarily Java.
- rjurney 17y agoOf course I'm talking about those subset of problems which are CPU bound and also use huge data. As to why streaming is slow: I don't know. It just is. Check it out. C++ streaming performance is the pits.