There's lots of work in this area. Quantization is a common technique. See for example https://pytorch.org/docs/stable/quantization.html https://pytorch.org/do

There's lots of work in this area. Quantization is a common technique. See for example https://pytorch.org/docs/stable/quantization.html https://pytorch.org/docs/stable/quantization.html