4 ms·
Exactly. Drives me crazy when people compare to a single alogrithm chip. It is not.
by jacksmith21006 8y ago
Exactly. Drives me crazy when people compare to a single alogrithm chip. It is not.
- deepnotderp 8y agoBut the TPU actually is: it's a systolic array matrix multiply ASIC.
- jacksmith21006 8y agoThe TPUs support all kinds of NN. Not specific to one type.
- deepnotderp 8y agoIndeed, all neural nets that use matrix multiplication. Out just so happens to be all the main types right now.
- jacksmith21006 8y agoGoogle is the leader on AI algorithms. Where GANs and Capsules and so many others came from for example. So things change and Google can implement in silicon far earlier than anyone else as needed. But right now they have what they need. BTW, I would be curious on the TPU 3 design considerations to better support dynamic routing with Capsule networks. I suspect creates different memory access patterns and where the big power savings are at today.
- shaklee3 8y agoYou are constantly comparing this single-purpose chip to a general-purpose GPU. How is that any different?