4 ms·You can run the smaller distilled models, depending on your RAM. Probably the 14b.by svachalek 2y agoYou can run the smaller distilled models, depending on your RAM. Probably the 14b.