Oh don’t get me wrong - the “architect” on that project is in over his head. The thing is, starting a DataBricks cluster can take 2-3 minutes. If you can’t ke

Oh don’t get me wrong - the “architect” on that project is in over his head. The thing is, starting a DataBricks cluster can take 2-3 minutes. If you can’t keep it running, you have to bear that cost every time you want to use it. You know, like when you are batch processing... But when you’ve got an on-premise server with a nice fat fiber channel connection to an nvme Pure Storage SAN and a processor that is really good at I/O, it’s going to be pretty fast.