3 ms·
You can already hook together TPUs. So, IMO, it is here or there what is happening in the data center. What I care about is how much is the cost. Time to tr
by jacksmith21006 8y ago
You can already hook together TPUs. So, IMO, it is here or there what is happening in the data center. What I care about is how much is the cost. Time to train is more of a function of how much resources I want to use.
- Voloskaya 8y agoSo what? I just want to know if the 8x speed increase was achieve at roughly the same cost (i.e same numbers of TPUs) or not. If the 8x speed increase was achieve with 4x more TPUs (and roughly 4x the cost) like it seems it was, then this is just marketing bullshit, and we should really expect a 2x improvement in cost/perf ratio not 8x.
- jacksmith21006 8y agoI am also curious. But really it comes down to cost. Right now we see about 1/2 the cost of using TPUs versus Nvidia on the AWS cloud. Will be interesting to see if the difference grows further with the TPU 3.0 or Google will just take larger margins.