3 ms·

Gaudi2 and Inferentia2 are both good. We train on A100s, TPUs and... other things now.

• emadm 3y ago
  Also missed in the post is fp8 is really much more efficient The H100s are actually very good for inference..