3 ms·
Because you can quantize a model e.g. from original 16 bits down to 5 bits per weight to fit your available memory constraints.
by magnat 2y ago
Because you can quantize a model e.g. from original 16 bits down to 5 bits per weight to fit your available memory constraints.