2 ms·

Or even lower, companies are experimenting with ternary, fp8, etc. for inference tasks.

• deepnotderp 9y ago
  This is explicitly for training, their first generation was for inference and used INT8 math.