3 ms·
What you're talking about here is the client/inference side, not the server/training side of the ML/DL compute battle. The former is meaningful in a sense, but
by snoshy 6y ago
What you're talking about here is the client/inference side, not the server/training side of the ML/DL compute battle. The former is meaningful in a sense, but practically insignificant in relation to the latter. Almost all ML/DL compute GPU, CPU, or otherwise is on the server side of the equation, and if you're relying on vector CPU math for it, well good luck.
Accelerators have a very clear space for themselves on the training side, and no amount of fancy ISA magic is really going to make up for the fact that TPUs and the like beckon. It's where most of the real money is.
- sradman 6y agoWayne Gretzky: "I skate to where the puck is going, not where it has been.” Intel Acquires Artificial Intelligence Chipmaker Habana Labs [1]: > Intel estimates the total addressable market (TAM) for AI silicon by 2024 will be greater than $25 billion, and within that, AI silicon in the data center is expected to be greater than $10 billion in the same timeframe. Amazon EC2 instances powered by Habana Gaudi [2]: > Up to 40% better price performance for deep learning models Matrix CPU math is another plausible future; Intel, AMD, and/or ARM are positioned to drive such an ISA extension. Accelerators, coprocessors, FPGAs, and CPU ISA extensions all seem to be in play; it is too early to pick winners in this nascent market. [1] https://newsroom.intel.com/news-releases/intel-ai-acquisition/ https://newsroom.intel.com/news-releases/intel-ai-acquisitio... [2] https://aws.amazon.com/ec2/instance-types/habana-gaudi/ https://aws.amazon.com/ec2/instance-types/habana-gaudi/