I think generally the benefit of cloud is either where your demands are very elastic, or if you are essentially a fractional user - a single server or GPU would

I think generally the benefit of cloud is either where your demands are very elastic, or if you are essentially a fractional user - a single server or GPU would be overkill. Once you have heavy and/or unconventional compute needs, it's likely cheaper to self-host or colo purchased hardware.