3 ms·
One of the major advantages of Nvidia GPUs is that they can do both training and inference. If you make an inference only chip, you better be damn sure that it
by aurareturn 2mo ago
One of the major advantages of Nvidia GPUs is that they can do both training and inference.
If you make an inference only chip, you better be damn sure that it's significantly better than Nvidia's GPUs at it.
Otherwise, it's better to buy Nvidia' GPUs because they're more flexible. You can do a big training run, then use them for inference right after.