8 ms·
In my experience AWS Nvidia machines are extremely overpriced. $30/hour for 8 A100s, and you have to pay for all 8 at a time. Most competitors I have seen are a
by janalsncm 3y ago
In my experience AWS Nvidia machines are extremely overpriced. $30/hour for 8 A100s, and you have to pay for all 8 at a time. Most competitors I have seen are around half that price.
At $30/hour I’m literally spending a dollar or two just installing dependencies.
Whether AWS custom hardware is reasonably priced, and how much of a pain in the butt it will be to port my code, and how training speed compares to Nvidia GPUs will be my main deciding factors. I’m not locked in to AWS so Trainium will need to be faster and cheaper (cheaper per epoch) to be competitive for me.
- thrtythreeforty 3y agoCan't you install dependencies on a potato instance then change the instance to the GPU when you're ready to roll?
- dylan604 3y agoI was wondering the same thing of why not have an image ready to go, but then realized why take away the easy complaint with rational logic?
- buildbot 3y agoThat only helps if your dependencies are slower moving targets than whatever research/product you are working on. Otherwise, the dependencies may be different each experiment or attempt. Or whatever cloud provider you use does something funky and the setup on one machine is less portable to a GPU machine than you might expect.
- janalsncm 3y agoThe $2 dependency installation cost isn’t the problem, it’s the $30/hour training cost.
- cbsmith 3y agoA month with an a2-ultragpu-8g is going to cost you ~$6400/month or about $36.92. Where are you getting half price?