3 ms·
Demand driven mainly by hyperscalers. And hyperscalers (MSFT as an example) are aggressively forcing customers (using tactics such a latency/performance comprom
by mrbungie 2y ago
Demand driven mainly by hyperscalers. And hyperscalers (MSFT as an example) are aggressively forcing customers (using tactics such a latency/performance compromises, one example being completions in 30 secs vs 1.5 min for the same prompt) to move from a Pay2Go schemes to buying Provisioned Throughput Units with minimum commitments in the order of 16-32k USD monthly with big penalties if you don't forecast your own demand with enough accuracy. Those half-assed offerings may be "interesting" to enterprise customers, but the intermediate/final consumer demand is not going to be in the scale where you think everyone and their grandma are going to use AI (as NVDA investors want to believe), the value is just not there.
That should say enough about the confidence in the capacity of such giant investments in GPUs to bring revenue in the short term future. They're not selling surplus capacity (from their own products as Copilot), they're hoping to sell snake oil directly to customers.