fp8 and fp4 are already the standard data types, where are you going to find a 20x reduction? At 1 sign bit, 1 exponent and 2 mantissa bits, there is barely an

fp8 and fp4 are already the standard data types, where are you going to find a 20x reduction? At 1 sign bit, 1 exponent and 2 mantissa bits, there is barely any work done during multiplication into a bf16 accumulator. You're performing two shifted adds at this point.