3 ms·pretty much all Q_4 models on huggingface fit in consumer grade cards.by nurettin 1y agopretty much all Q_4 models on huggingface fit in consumer grade cards.