5 ms·

How widespread is Slurm?

jhfdbkofdchk 3y ago
According to Wikipedia, "Slurm is the workload manager on about 60% of the TOP500 supercomputers." I have used it as a job manager front end for most computational clusters in the last 10 years or so.
vulcan01 3y ago
It's used in most high-performance computing clusters (except for the folks that are still on Torque, I guess).
- legerdemain 3y ago
  I see, so it's limited to HPC contexts? I'm just surprised that as a data engineer, I've never seen it in real life.
  - a_bonobo 3y ago
    Definitely! I was in academia for ten years and SLURM is everywhere. It's free! Now outside academia, SLURM is nowhere. AWS and Slowflake are king.
    - jebarker 3y ago
      > Now outside academia, SLURM is nowhere Do you mean outside of academia _and_ HPC? Industry HPC clusters using slurm are quite common.
    - 0cf8612b2e1e 3y ago
      Both of my last two companies used Slurm. Probably just comes down to if the company maintains its own internal compute cluster.
p4ul 3y ago
Slurm is absolutely ubiquitous in the high-performance computing (HPC) community. I believe its only similar competitors in the HPC space are the SGE [1] and Torque/PBS [2] resource schedulers. I'm not sure of the exact numbers, but I would guess that an overwhelming majority of the Top 500 Supercomputers [3] are running Slurm. And as others have noted, research computing centers in academia all mostly run Slurm. And Slurm also dominates in the DoE national labs in the US. Oh, and as a [potentially apocryphal] fun fact, the name "Simple Linux Utility for Resource Management (SLURM)" is a backronym from the soda in Futurama! [4] [1] https://en.wikipedia.org/wiki/Oracle_Grid_Engine https://en.wikipedia.org/wiki/Oracle_Grid_Engine [2] https://github.com/adaptivecomputing/torque https://github.com/adaptivecomputing/torque [3] https://www.top500.org/ https://www.top500.org/ [4] https://futurama.fandom.com/wiki/Slurm https://futurama.fandom.com/wiki/Slurm
nikhilsimha 3y ago
Llama 2 models were trained on slurm
claytonjy 3y ago
related, has anyone had success moving from Slurm to Kubernetes for a physical (non-cloud) cluster primarily used for training large models on lots of GPUs?
sbekman 3y ago
Many compute clouds provide SLURM env - definitely AWS and GCP do.

According to Wikipedia, "Slurm is the workload manager on about 60% of the TOP500 supercomputers." I have used it as a job manager front end for most computational clusters in the last 10 years or so.

vulcan01 3y ago

It's used in most high-performance computing clusters (except for the folks that are still on Torque, I guess).

legerdemain 3y ago
I see, so it's limited to HPC contexts? I'm just surprised that as a data engineer, I've never seen it in real life.
- a_bonobo 3y ago
  Definitely! I was in academia for ten years and SLURM is everywhere. It's free! Now outside academia, SLURM is nowhere. AWS and Slowflake are king.
  - jebarker 3y ago
    > Now outside academia, SLURM is nowhere Do you mean outside of academia _and_ HPC? Industry HPC clusters using slurm are quite common.
  - 0cf8612b2e1e 3y ago
    Both of my last two companies used Slurm. Probably just comes down to if the company maintains its own internal compute cluster.

p4ul 3y ago

Slurm is absolutely ubiquitous in the high-performance computing (HPC) community. I believe its only similar competitors in the HPC space are the SGE [1] and Torque/PBS [2] resource schedulers. I'm not sure of the exact numbers, but I would guess that an overwhelming majority of the Top 500 Supercomputers [3] are running Slurm. And as others have noted, research computing centers in academia all mostly run Slurm. And Slurm also dominates in the DoE national labs in the US. Oh, and as a [potentially apocryphal] fun fact, the name "Simple Linux Utility for Resource Management (SLURM)" is a backronym from the soda in Futurama! [4] [1] https://en.wikipedia.org/wiki/Oracle_Grid_Engine https://en.wikipedia.org/wiki/Oracle_Grid_Engine [2] https://github.com/adaptivecomputing/torque https://github.com/adaptivecomputing/torque [3] https://www.top500.org/ https://www.top500.org/ [4] https://futurama.fandom.com/wiki/Slurm https://futurama.fandom.com/wiki/Slurm

nikhilsimha 3y ago

Llama 2 models were trained on slurm

claytonjy 3y ago

related, has anyone had success moving from Slurm to Kubernetes for a physical (non-cloud) cluster primarily used for training large models on lots of GPUs?

sbekman 3y ago

Many compute clouds provide SLURM env - definitely AWS and GCP do.