3 ms·
what language/frameworks orchestrate work across 10k cores? is that like, 10k threads? 10k processes?
by MuffinFlavored 3y ago
what language/frameworks orchestrate work across 10k cores? is that like, 10k threads? 10k processes?
- uguuo_o 3y agoIt is not a single language. c, C++, Fortran are the most commonly used. The communication happens using one of many versions of the message passing interface [0] (MPI). MPI essentially spawns child processes and a communication ring between nodes using whichever interconnect is available (usually infoniband). [0] https://en.m.wikipedia.org/wiki/Message_Passing_Interface https://en.m.wikipedia.org/wiki/Message_Passing_Interface