4 ms·
> TPU doesn't kick the ass of the NVIDIA chips It used to until Volta came out with basically TPUs embedded on the board. We will see if AMD will join them as
by bitL 9y ago
> TPU doesn't kick the ass of the NVIDIA chips
It used to until Volta came out with basically TPUs embedded on the board. We will see if AMD will join them as Vega in theory should be around Volta as well, just tooling is not there.
- twtw 9y agoHow long has Google had the TPUv2 for internal use? I was under the impression that V100 and TPUv2 where developed around same time. They were certainly announced around the same time at least. Just seems weird to say "it used to," when V100 has been shipping since mid-summer 2017.
- bitL 9y agoI think at least for inference TPUv1 was beating all previously available GPUs by a wide margin. TPUv2 did that for training as well, with the exception of Volta.