3 ms·
"These FP16 operations are very useful for some kinds of calculations." ML for example. If you use 16bit precision you can fit the model in half the memory and
by more_corn 5y ago
"These FP16 operations are very useful for some kinds of calculations."
ML for example. If you use 16bit precision you can fit the model in half the memory and your lookups are twice as fast. Newer GPU models offer "mixed precision mode" It takes some doing to get that working in your tooling though.
- freeone3000 5y agoLess than it used to! Apex now offers automatic mixed precision on cublas operations, so you get a good bit of result even without a significant code change.