People have engineered solutions to make what is available practical (see all the various quantization schemes that have come out). It is just that there's a l

People have engineered solutions to make what is available practical (see all the various quantization schemes that have come out). It is just that there's a limit to how much you can compress the models.