4 ms·Look on youtube running various models and even a 70b model does a slow 3tok/sby novok 2y agoLook on youtube running various models and even a 70b model does a slow 3tok/s