It's been known for a while now that quantization of neural networks greatly increases efficiency while not decreasing inference power much --- NNs are great at

It's been known for a while now that quantization of neural networks greatly increases efficiency while not decreasing inference power much --- NNs are great at dealing with noise, and squashing a float weight into a byte is just adding noise. These people seem to have quantized "all the way" as it were, which makes sense.