3 ms·
The phrasing is very precise here, it’s the first TPU for _the age of inference_, which is a novel marketing term they have defined to refer to CoT and Deep Res
by theptip 2y ago
The phrasing is very precise here, it’s the first TPU for _the age of inference_, which is a novel marketing term they have defined to refer to CoT and Deep Research.
- shitpostbot 2y agoThey didn't though? > first designed specifically for inference. For more than a decade, TPUs have powered Google’s most demanding AI training and serving workloads... What do they think serving is? I think this marketing copy was written by someone with no idea what they are talking about, and not reviewed by anyone who did. Also funny enough it kinda looks like they've scrubbed all their references to v4i, where the i stands for inference. https://gwern.net/doc/ai/scaling/hardware/2021-jouppi.pdf https://gwern.net/doc/ai/scaling/hardware/2021-jouppi.pdf
- dang 2y agoUgh. We should have caught that. Can anyone suggest a better (i.e. more accurate and neutral) title, devoid of marketing tropes?
- yencabulator 2y agoAs a previous boss liked to say, this car is the cheapest in its price range, the roomiest in it's size category, and the fastest in its speed group.