3 ms·Yes they have quants for 32GB and 20GB use-cases (including mmproj and kv cache + context)by skohan 3mo agoYes they have quants for 32GB and 20GB use-cases (including mmproj and kv cache + context)