3 ms·
> they're a tech. island because nobody can easily run their models on that stack You can easily train and serve models on TPU through Google's cloud services.
by kajecounterhack 2y ago
> they're a tech. island because nobody can easily run their models on that stack
You can easily train and serve models on TPU through Google's cloud services. Colab for example makes it easy to train models on TPU.
> TPUs are not faster than H100s
There are several generations of TPU with different characteristics, some oriented toward serving, some toward training, and all toward minimizing TCO. You might give up FLOPs but have much faster memory bandwidth, or be overall similar but have a much more efficient data pipeline thanks to Google's scaled infrastructure, netting out ahead. The OP isn't a wanker for pointing out that long-term infra investment is paying off for Google.