Much of the last 5 years of AI improvements have been FP32 -> FP16 -> FP8 -> FP4, not any particularly impressive hardware or software improvements. Similarly

Much of the last 5 years of AI improvements have been FP32 -> FP16 -> FP8 -> FP4, not any particularly impressive hardware or software improvements. Similarly on the GPU side much of the improvements is more fake pixels and more fake frames, now we can have multiple fake frames per real frame.