I think this is definitely the future for a lot of developers. Though, like other serverless platforms once you start getting scale this will likely be more exp

I think this is definitely the future for a lot of developers. Though, like other serverless platforms once you start getting scale this will likely be more expensive than always on variants. GCP recently announced Cloud Run can do, more or less, what you are proposing. It scales to zero, and you only pay for the request duration. https://cloud.google.com/run/docs/configuring/services/gpu-best-practices https://cloud.google.com/run/docs/configuring/services/gpu-b...