The actual cost of running a cloud instance is inflated. The cheapest way to run them is using spot/interruptible instances which for most deep learning jobs wi

The actual cost of running a cloud instance is inflated. The cheapest way to run them is using spot/interruptible instances which for most deep learning jobs will suffice. If anything there will be some upfront cost to set it up in a way that it automatically manages interruptions, storage etc. Also by not limiting yourself to AWS you can have many other options. With this setup you can get 2x4x V100 on Azure for a total of $42k/year (assuming running 24/7). Even if one spent $40k to write code for spot instance management this is by far the cheapest solution for GPU compute both short term and long term. source for calculation: https://cloudoptimizer.io https://cloudoptimizer.io