> which are typically INT8 These systems are used for training which is VERY rarely INT8. On Frontier, for example, it's recommended to use bfloat16 or float32

> which are typically INT8 These systems are used for training which is VERY rarely INT8. On Frontier, for example, it's recommended to use bfloat16 or float32 if that doesn't work for you/your application. Nvidia has FP8 with >=Hopper and supposedly AMD MI300 has it as well although I have no experience with the MI300 so I can't speak to that.