2 ms·
This was a fascinating look at an HPC person't thought on Hadoop. Interesting that before Beowulf "super computing" was exemplified by the Cray series. The word
by ChuckMcM 13y ago
This was a fascinating look at an HPC person't thought on Hadoop. Interesting that before Beowulf "super computing" was exemplified by the Cray series. The word was that NUMA was incompatible with HPC, but folks found ways around that.
Its a totally valid observation that many HPC problems are not amenable to a Hadoop cluster, but it is not clear to me yet that there are no HPC problems that a distributed data approach might do better than the current system :-)
- KaiserPro 13y agoScheduling is what HPC can do much better. The concept of data/message/cache/storage/memory affinity seems to be a novelty.