3 ms·
> Integer arithmetic is still simpler to implement in hardware and therefore faster than floating point arithmetic This is true in the abstract, but not necess
by wtallis 5y ago
> Integer arithmetic is still simpler to implement in hardware and therefore faster than floating point arithmetic
This is true in the abstract, but not necessarily true of a specific commodity chip. Processor vendors spend a lot of silicon on offering low latency and high throughput floating point support. It's a fairly recent trend of processor vendors adding fast int8 or bfloat16 vectors after the ML craze demonstrated that there was demand for vector support for more bandwidth-friendly datatypes.
- chas 5y agoIt is absolutely very dependent on your specific hardware. I would expect dedicated digital signal processor chips to almost always support a high-performance fixed-point multiply-add instruction. In contrast, I would expect chips targeted and HPC or scientific computing to be much more focused on double throughput than anything else.