4 ms·Yes they have quants for 32GB and 20GB use-cases (including mmproj and kv cache + context)by skohan 2mo agoYes they have quants for 32GB and 20GB use-cases (including mmproj and kv cache + context)