3 ms·Or 4 thousand for the NVIDIA RTX A6000 which also runs the 120b just fine (quantized).by cfn 9mo agoOr 4 thousand for the NVIDIA RTX A6000 which also runs the 120b just fine (quantized).