In terms of production pipeline, sure. But since there’s an established model architecture, the hardware doesn’t need to be super generic. Google had to build

In terms of production pipeline, sure. But since there’s an established model architecture, the hardware doesn’t need to be super generic. Google had to build TPUs in a world where everything was still rapidly changing - deciding on things like precision, memory bandwidth, SRAM size etc. Microsoft could theoretically stamp out some GPT ASICS and call it a day.