3 ms·
Your comment is simply incorrect. Amazon has had their own TPU equivalents for training and inference for years: https://aws.amazon.com/machine-learning/traini
by coder543 4y ago
Your comment is simply incorrect. Amazon has had their own TPU equivalents for training and inference for years:
https://aws.amazon.com/machine-learning/trainium/ https://aws.amazon.com/machine-learning/trainium/
https://aws.amazon.com/machine-learning/inferentia/ https://aws.amazon.com/machine-learning/inferentia/
I really don't think this would be a limiting factor regardless, even if Amazon didn't already have multiple generations of these products. It's not as if an Amazon or Microsoft sized company is incapable of developing custom silicon to meet an objective, once an objective is identified. TPUs also aren't really that complicated to design, at least compared to GPUs.
I'm slightly surprised Microsoft hasn't bothered to release any custom ML chips for Azure yet, but I guess they've run the numbers and decided to focus on other priorities for now.