I don’t know about the L40S but my experience with the L40 hasn’t been so good. I would say it’s okay-ish to decent for inference. Horribly slower than a H100 o

I don’t know about the L40S but my experience with the L40 hasn’t been so good. I would say it’s okay-ish to decent for inference. Horribly slower than a H100 or even a A100 for training. The FP8 and higher cuda level is nice I guess, if your toolchain supports it.