4 ms·
The only thing that diminishes the value of a GPU right now is unsupported features with outsized value during inference and/or training (like FP4 support) and
by BoorishBears 3mo ago
The only thing that diminishes the value of a GPU right now is unsupported features with outsized value during inference and/or training (like FP4 support) and it takes time for those features to actually take off
And labs are fully leaning into pricing for intelligence, so their margins are improving very quickly (which allows them to pay even more for existing compute)
I'd be shocked if current prices aren't the bottom for the next 18-24 months.
- bradfa 3mo agoMany newer Chinese lab models are releasing with int4 native weights. Latest NVIDIA generation GPUs have a hard time with this and can actually be slower than previous generations. This may make Blackwell depreciate faster than other recent generations.
- BoorishBears 3mo agoThat's not a real problem, hardly any 3rd party was running native weights anyways so they'll get quantized to NVFP4