8 ms·Exactly, 5 tok/s is just fast enough for real-time speech.by samwillis 3y agoExactly, 5 tok/s is just fast enough for real-time speech.