Well there is TPU, and it is at least as good as GPU for training, all Google's models are trained TPU, it is the best class of training chips in industry. Sec

Well there is TPU, and it is at least as good as GPU for training, all Google's models are trained TPU, it is the best class of training chips in industry. Second, there is no need to be market leading, it just needs to be cost efficiently to be successful, even if it is slower, as long as it is cheaper. All cloud providers have huge chip design/manufacturing history, AWS/Azure and Google. I would argue it IS indeed the core competency for those cloud providers, because of price. The inhouse chips exist because they can reduce the cost. I know for a fact, there is huge momentum in some big clouds to replace Nvidia GPUs with their own chips, at least for their internal compute needs at first.