2 ms·
Inference can be more easily offloaded to other kinds of processing units, which also probably are more efficient, like TPUs. That makes both NVDA stock and bi
by mrbungie 2y ago
Inference can be more easily offloaded to other kinds of processing units, which also probably are more efficient, like TPUs.
That makes both NVDA stock and big AI infrastructure spending less compelling, as those needs are scaled down via software efficiency and chip alternatives.