4 ms·
They didn't though? > first designed specifically for inference. For more than a decade, TPUs have powered Google’s most demanding AI training and serving work
by shitpostbot 1y ago
They didn't though?
> first designed specifically for inference. For more than a decade, TPUs have powered Google’s most demanding AI training and serving workloads...
What do they think serving is? I think this marketing copy was written by someone with no idea what they are talking about, and not reviewed by anyone who did.
Also funny enough it kinda looks like they've scrubbed all their references to v4i, where the i stands for inference. https://gwern.net/doc/ai/scaling/hardware/2021-jouppi.pdf https://gwern.net/doc/ai/scaling/hardware/2021-jouppi.pdf