4 ms·

I’m surprised not to see fused multiply-add here: FMA(x,y,z) ~ x += y*z You see it all over the place in numerical computing and deep learning.

• achierius 2y ago
  It'd be syntactic sugar for two binary operations: `tmp = y*z; x += tmp`
  • atq2119 2y ago
    It actually isn't, that's what makes it fused. If you separate the operations like that, the intermediate result is rounded. The final result is then often different from the result of the FMA, which doesn't do the intermediate rounding.
  • NooneAtAll3 2y ago
    in hardware it isn't sugar - there's (pipeline) gains to be gained from literally "fusing" the two into a single circuit