3 ms·3090 can handle the ~30B models quantized to 4 bits.by redox99 3y ago3090 can handle the ~30B models quantized to 4 bits.