3 ms·

> Add MPI to the mix, and you can distribute that work to multiple machines. Potentially to thousands of them. My understanding is that coarrays are a modern r

> Add MPI to the mix, and you can distribute that work to multiple machines. Potentially to thousands of them. My understanding is that coarrays are a modern replacement for MPI and that coarrays abstract the notion of "machines", they bundle that under "multiple CPUs". I'm not very fluent in either of those, only know as much as the "Modern Fortran" book explains but from the examples I have seen, coarrays can do anything MPI can and they're simpler to work with. > So, having one trick is not a bad thing here. Definitely not. Personally, I would imagine myself using it if integration with other technologies over the network was available out of the box.

m_mueller 4y ago
Aren’t coarrays only for single machine CPU parallelization? I‘d be surprised if you could abstract a whole network topology over it. The MPI communicator is really where it’s at when you want to drive a whole cluster (and if you’re using Fortran, you probably do).
- bayindirh 4y ago
  A quick glance at Coarray Fortran [0] shows that Coarray library is built on top of MPI instead of replacing it. MPI and InfiniBand are irreplaceable technologies for HPC clusters as of today, both in terms of speed and latency. Lastly IB is not a connectivity layer. It's a HBA which carries information from memory space of one application to another. So it's properly "Magick" in terms of programming and research. [0]: https://en.wikipedia.org/wiki/Coarray_Fortran https://en.wikipedia.org/wiki/Coarray_Fortran
  - TheRealKing 4y ago
    not necessarily. But at least one of the major Coarray implementations (Intel Fortran compiler) translates the Coarray syntax to MPI so that the Intel MPI library can be used underneath. As a counter-example, the NAG Fortran compiler implements Coarrays for shared-memory architecture, and apparently has nothing to do with MPI.
jabl 4y ago
> My understanding is that coarrays are a modern replacement for MPI Well, yes and no. Co-arrays are a higher level abstraction, belonging to the category of Partitioned Global Address Space (PGAS). Depending on the implementation, co-arrays might very well be implemented on top of a MPI library (as there has been a huge amount of work making MPI fast over all kinds of fancy interconnect fabrics).

m_mueller 4y ago

Aren’t coarrays only for single machine CPU parallelization? I‘d be surprised if you could abstract a whole network topology over it. The MPI communicator is really where it’s at when you want to drive a whole cluster (and if you’re using Fortran, you probably do).

bayindirh 4y ago
A quick glance at Coarray Fortran [0] shows that Coarray library is built on top of MPI instead of replacing it. MPI and InfiniBand are irreplaceable technologies for HPC clusters as of today, both in terms of speed and latency. Lastly IB is not a connectivity layer. It's a HBA which carries information from memory space of one application to another. So it's properly "Magick" in terms of programming and research. [0]: https://en.wikipedia.org/wiki/Coarray_Fortran https://en.wikipedia.org/wiki/Coarray_Fortran
- TheRealKing 4y ago
  not necessarily. But at least one of the major Coarray implementations (Intel Fortran compiler) translates the Coarray syntax to MPI so that the Intel MPI library can be used underneath. As a counter-example, the NAG Fortran compiler implements Coarrays for shared-memory architecture, and apparently has nothing to do with MPI.

jabl 4y ago

> My understanding is that coarrays are a modern replacement for MPI Well, yes and no. Co-arrays are a higher level abstraction, belonging to the category of Partitioned Global Address Space (PGAS). Depending on the implementation, co-arrays might very well be implemented on top of a MPI library (as there has been a huge amount of work making MPI fast over all kinds of fancy interconnect fabrics).