4 ms·
Guaranteed to be fp16.
by deepnotderp 9y ago
Guaranteed to be fp16.
- arcanus 9y agoOr even lower, companies are experimenting with ternary, fp8, etc. for inference tasks.
- deepnotderp 9y agoThis is explicitly for training, their first generation was for inference and used INT8 math.
- davidmr 9y agoEven for training? That would be disappointing.