3 ms·
Maybe not the MPI protocol specifically, but there are probably more users and implementors of HPC style applications in the business world using Java than in t
by fulafel 10y ago
Maybe not the MPI protocol specifically, but there are probably more users and implementors of HPC style applications in the business world using Java than in the scientific computing world. It's become mainstream with all the ready to run data-crunching-in-cluster stuff available on AWS.
Stuff like: http://spark.apache.org/news/spark-wins-daytona-gray-sort-100tb-benchmark.html http://spark.apache.org/news/spark-wins-daytona-gray-sort-10...
- agibsonccc 10y agoRight that's what I was talking about though. I mentioned spark and flink in my original comment. Spark makes different assumptions about the computers than what MPI does. "HPC" is 99% of the time some variant of MPI with some sort of special hardware interconnect like infiniband. It's just in general a different software stack with different assumptions. Like I said- I work on gpu stuff for the JVM as well, the assumption is different with how the cluster is expected to be setup though.