3 ms·
Thanks for commenting! > Between nodes, it gets more fun...however it's still a rather well understood problem. Indeed it's understood, but the scalability pr
by vmarsy 10y ago
Thanks for commenting!
> Between nodes, it gets more fun...however it's still a rather well understood problem.
Indeed it's understood, but the scalability problems switch somewhere else once your communication becomes the bottleneck. One advantage of dataflow-like paradigms like yours is that you can avoid major barriers like in Bulk-Syhnchronous-style programs. Those barriers start to become costly when you run with ten/hundreds of thousands processors. That'd be super interesting to see your library scale in those settings, similar to [1].
[1] https://www.researchgate.net/profile/Mani_Zandifar/publication/279286000_The_stapl_Skeleton_Framework/links/56327c9208ae242468d9f8df.pdf https://www.researchgate.net/profile/Mani_Zandifar/publicati...