It sounds like you might be wanting something for GPU batch job management. Some things to check out would be gpu orchestration tools, specifically: Slurm, Run.

It sounds like you might be wanting something for GPU batch job management. Some things to check out would be gpu orchestration tools, specifically: Slurm, Run.ai, and Skypilot. Or maybe you're kind of wanting a serverless GPU cloud - check out Runpod, Modal, Baseten, and Replicate. Links: https://slurm.schedmd.com/documentation.html https://slurm.schedmd.com/documentation.html https://www.run.ai/ml-workflow-management https://www.run.ai/ml-workflow-management https://github.com/skypilot-org/skypilot https://github.com/skypilot-org/skypilot https://www.runpod.io/serverless-gpu https://www.runpod.io/serverless-gpu https://modal.com/pricing https://modal.com/pricing https://www.baseten.co/pricing/ https://www.baseten.co/pricing/ https://replicate.com/pricing https://replicate.com/pricing