2 ms·
According to the post, it’s only 2x cheaper. So for the same dollars spent, I would cut my time from 48 hours to 24. But, TPUs are not standard, can’t be used
by aey 7y ago
According to the post, it’s only 2x cheaper. So for the same dollars spent, I would cut my time from 48 hours to 24.
But, TPUs are not standard, can’t be used for any other usecase. So those savings might not actually be realizable when everything is taken into account.
- p1esk 7y agoWhy would you use cloud if you do a lot of training? Quad 2080Ti systems cost ~$7k + electricity. Assuming two such systems are equivalent in speed to 1 TPUv3 (4 chips), owning them would be more cost efficient after 4-5 months of training (depending on your electricity costs). TPUs do have the memory capacity advantage though (over 2080Ti).
- solidasparagus 7y agoThat is not what the blog is saying. The blog post does not consider cost - it simply shows that a TPU v3 Pod is twice as fast as the largest DGX-2h cluster.