The sensible thing to do at this point is to have a hybrid setup and being able to move load between Cloud providers and from/to on-prem. I understand this is n

The sensible thing to do at this point is to have a hybrid setup and being able to move load between Cloud providers and from/to on-prem. I understand this is not always practical, but it is going to be a big lever to keep costs down. A Databricks instance running on Cloud can be probably 10x of the cost of running Spark clusters on-prem. Does it make sense? Well, it depends, if you are spending 1m in Databricks charges it does, if you are spending 100k it does not. But I don't see much of these discussions in IT, I think part of the problem is that Cloud charges are hard to monitor and budget.