3 ms·
Found the HPC guy. I was so excited for this until I got to that line. I'll still be following this closely though, the potential is huge.
by Atreiden 4y ago
Found the HPC guy. I was so excited for this until I got to that line. I'll still be following this closely though, the potential is huge.
- mbreese 4y agoSo, you’ve been waiting for something like this too? I’d love to be able to submit Slurm jobs backed by a Docker container. That would be a reproducibility dream for me. And make it so I didn’t have to install so much software or still maintain Environment modules. As it is, I can get partially there with Singularity, which isn’t terrible.
- Atreiden 4y agoAbsolutely. With firecracker, AWS seems to have solved the multi-tenancy problem that has plagued HPC since its inception. I've just been waiting for some way to implement that in a sane way for on-prem infrastructure. If not for the root requirement, this would be perfect. Singularity does get us part of the way there, but it's just another abstraction layer that researchers have to work around. And it's far from perfect.