4 ms·
Any way to compute in HPC clusters using FaaS?
by deepnotderp 9y ago
Any way to compute in HPC clusters using FaaS?
- shaunray 9y agoNot where you can bring your own image as of yet. Although Thomasj above mentions you can do this in OpenWhisk. The closest to scientific HPC I have used personally is pywren https://github.com/pywren/pywren https://github.com/pywren/pywren Which is attempting to add more cloud backends. It's out of Berkley University.
- stochastician 9y agoHi! Pywren project lead here, we're working on more and more fun HPC-style projects! We're also interested in expanding to more and more backends, so please feel free to reach out if there's something you'd like to see.
- deepnotderp 9y agoI meant more like the opposite, where you can do parallel computing in a cluster by using a simple serverless FaaS paradigm. The idea is to remove the headache of manually setting up an MPI cluster, worrying about MPI communications, etc.