3 ms·
That "TPU advantage" might be slowing Google down (though likely not as much as their internal bureaucracy). Porting CUDA-based research, debugging, and overal
by deltaqueue 2mo ago
That "TPU advantage" might be slowing Google down (though likely not as much as their internal bureaucracy).
Porting CUDA-based research, debugging, and overall experimentation speed is likely slower.
The GPU is still king for training.
- anthonypasq 2mo agolmao, you know all Anthropic models are trained on TPU right?
- zobzu 2mo agothats funny because my company sells them nvidia gpu for training. but im happy for the billions, they prolly use them for counterstrike!
- awongh 2mo agoBut maybe the TPU advantage is in inference? That's what I assume because the number of compute cycles are going to be all in inference vs training. So they could train on GPUs if they want.