3 ms·
Since it supports distributed computation does it have any abstraction for dealing with failures, for example, network problems etc. Support for checkpointing o
by srean 11y ago
Since it supports distributed computation does it have any abstraction for dealing with failures, for example, network problems etc. Support for checkpointing or some other abstraction that deals with these kinds of errors would be very useful. In fact absolutely essential for anything of non-trivial scale.
BTW not complaining, far, far from it, just a useful feature addition you may consider in case you have the bandwidth to invest.
- haptork 11y agoYeah, you are right, fault tolerance is a needed feature. Although, I'm not pretty sure if that needs to be added to easyLambda itself. Since, MPI 3.0 is expected to support fault tolerance by default. But instead of waiting for MPI 3.0 fault tolerance support, I'm thinking of running it on top of HPX or some other system that provides good runtime support on top of MPI. Also, since most of parallelism scheme is confined to MPIBridge which is just a unit in the flow, these different implementations can coexist.