4 ms·
>There are two major shifts happening in AI, economically speaking: You can now spend more $ to get higher accuracy and reliability Training $ is moving to
by hnburnsy 2y ago
>There are two major shifts happening in AI, economically speaking:
You can now spend more $ to get higher accuracy and reliability
Training $ is moving to inference $
>Both are going to drive a massive amount of demand for inference and neither will curtail the demand for more compute. In fact, they will increase the demand for compute.
Is this Nvidia compute or something else?
- gorbypark 2y agoNvidia has much less of a moat on the inference side of things. Of course they still dominate the market right now for inference (in datacenters), but it's much easier for companies to move onto AMD or other solutions like Groq or whatever compared to trying to use non-Nvidia for training.