4 ms·

Yes FP16 is fully optimised on NVidia hardware; but if you don't support standards...

• Lerc 3y ago
  ...You gain a near monopoly by getting people to use your proprietary stack?
  • misnome 3y ago
    ... which you created when none of the other stacks existed, and stood behind for 20 years while all your competitors changed their mind about everything every couple of years.
• jimmySixDOF 3y ago
  I notice they didn't test against TPUv5 either ...
  • dhruvdh 3y ago
    Wouldn't surprise me if it's impossible to test against TPUs with Google not sharing low-level technical information and documentation from users.