> the current outlook is that we’ll be targeting specialized hardware more rather than less for the foreseeable future. I think there are some important questi

> the current outlook is that we’ll be targeting specialized hardware more rather than less for the foreseeable future. I think there are some important question marks still unresolved that bear on how things will play out. E.g. how the training versus inference balance will land in terms of usage and economics. Inference is inherently more "mass market". You need it locally without lags from moving data around. But inference is just numerical linear algebra. Ultimately augmenting the CPU to provide inference natively might be the optimal arrangement.