3 ms·No they don't. GGML is non-uniform. Each layer gets its own level of quantisation.by smcleod 1y agoNo they don't. GGML is non-uniform. Each layer gets its own level of quantisation.