3 ms·
But, I thought the CUDA moat is primarily needed for training. On the inference side, why does one need Nvidia GPUs over Intel and AMD GPUs?
by ijidak 2y ago
But, I thought the CUDA moat is primarily needed for training.
On the inference side, why does one need Nvidia GPUs over Intel and AMD GPUs?
- belter 2y agoTensor Cores accelerate inference...
- aurareturn 2y agoProbably because companies buy Nvidia GPUs training and then use them for inference. Dual use. Not to mention there’s little real world evidence that AMD is better at inference speed not cost/inference over Nvidia.