4 ms·
So what? I just want to know if the 8x speed increase was achieve at roughly the same cost (i.e same numbers of TPUs) or not. If the 8x speed increase was achi
by Voloskaya 8y ago
So what? I just want to know if the 8x speed increase was achieve at roughly the same cost (i.e same numbers of TPUs) or not.
If the 8x speed increase was achieve with 4x more TPUs (and roughly 4x the cost) like it seems it was, then this is just marketing bullshit, and we should really expect a 2x improvement in cost/perf ratio not 8x.
- jacksmith21006 8y agoI am also curious. But really it comes down to cost. Right now we see about 1/2 the cost of using TPUs versus Nvidia on the AWS cloud. Will be interesting to see if the difference grows further with the TPU 3.0 or Google will just take larger margins.