3 ms·How much RAM do you have? Mixtral is a beast and the non quantized model wants 40GB+ of memory.by Casteil 3y agoHow much RAM do you have? Mixtral is a beast and the non quantized model wants 40GB+ of memory.eurekin 3y agoAh, that might be it! I have only 32ukuina 3y agoThe q2 should fit.