3 ms·
I care because assuming the cost of a single TPUv3 is roughly similar to the cost of a single TPUv2 (at launch), then paying for a "pod" of 256 or 512 (whatever
by Voloskaya 8y ago
I care because assuming the cost of a single TPUv3 is roughly similar to the cost of a single TPUv2 (at launch), then paying for a "pod" of 256 or 512 (whatever a pod is this year) will be nowhere near the cost of 64 TPUv2 "pod".
So I care because I want to know if I will actually see this 8x speed improvement or if this is just marketing BS.
If NVIDIA tells me a 2080 is 8x time faster than a 1080, I know that a 2080 when released will be roughly the same price as the 1080 when it was released, and so I can expect to actually see a 8x cost/perf ratio improvement (if we put aside the fact that this are always best case scenarios)
- jacksmith21006 8y agoYou can already hook together TPUs. So, IMO, it is here or there what is happening in the data center. What I care about is how much is the cost. Time to train is more of a function of how much resources I want to use.
- Voloskaya 8y agoSo what? I just want to know if the 8x speed increase was achieve at roughly the same cost (i.e same numbers of TPUs) or not. If the 8x speed increase was achieve with 4x more TPUs (and roughly 4x the cost) like it seems it was, then this is just marketing bullshit, and we should really expect a 2x improvement in cost/perf ratio not 8x.
- jacksmith21006 8y agoI am also curious. But really it comes down to cost. Right now we see about 1/2 the cost of using TPUs versus Nvidia on the AWS cloud. Will be interesting to see if the difference grows further with the TPU 3.0 or Google will just take larger margins.