Yes LLMs are a funny workload. They require high amounts if processing but are very bursty. Therefore using your own bare metal is a low of expensive redundanc

Yes LLMs are a funny workload. They require high amounts if processing but are very bursty. Therefore using your own bare metal is a low of expensive redundancy. For the cloud provider they can utilise the GPU to make it pay. They can also subsidise it with VC money :)