2 ms·

From my mental math, you can run 4bit quant 7B, but the quality for that might not be what you're looking for.