4 ms·

Also missed in the post is fp8 is really much more efficient The H100s are actually very good for inference..