3 ms·
The real gem of the Mesos ecosystem was the much lesser known Singularity scheduler from HubSpot. https://github.com/HubSpot/Singularity https://github.com/Hub
by relistan 6y ago
The real gem of the Mesos ecosystem was the much lesser known Singularity scheduler from HubSpot.
https://github.com/HubSpot/Singularity https://github.com/HubSpot/Singularity
I've run this at scale, in production since 2015 and it has been absolutely rock solid and does most of the production things you'd want. Unlike commercial products, it was written to run HubSpot's own infrastructure so it does what a production system needs. Really bummed to have to downgrade to something like K8s in the near future.
- tpetr 6y agoThanks for the kind words! Singularity is still a core piece of infrastructure for running stateless apps at HubSpot (our status page currently reads ~13k Requests, ~22k Active Tasks, ~700 Agents). We're also heavily investing in Kubernetes, but Singularity is solid enough that our focus has been more towards reliably running and scaling stateful things like MySQL, ZK, Kafka, HBase, and ES.
- chucky_z 6y agoThere’s a Singularity driver for Nomad https://www.nomadproject.io/docs/drivers/external/singularity https://www.nomadproject.io/docs/drivers/external/singularit... Nomad is pretty darn easy to run and scales far. I help run about 20 clusters in day job from 100 to 1800 nodes, we’re going to push one of them to over 8500 nodes here soon too. We don’t use the Singularity driver but we wrote two of our own and they work well and are easy to maintain.