GPU depreciation cycles are slowing down a lot. A big chunk of frontier model inference is still being run on Hopper-era GPUs because anything more recent is h

GPU depreciation cycles are slowing down a lot. A big chunk of frontier model inference is still being run on Hopper-era GPUs because anything more recent is heavily bottlenecked and it makes more sense to use the newer stuff for training,