3 ms·
For inference there are many solutions like groq. The margins there will be small. The fat margins is in training, in NVidia hardware.
by thiago_fm 1y ago
For inference there are many solutions like groq. The margins there will be small.
The fat margins is in training, in NVidia hardware.
- aurareturn 1y agoInference margins will be small(er) but it will be much bigger in market size than training. That said, I'd much rather be leading in training than inference, of course. Nvidia still leads in inference, by the way.