3 ms·Well, since it affects inference speed it means you can handle more in less time, needing less concurrency.by tartrate 2y agoWell, since it affects inference speed it means you can handle more in less time, needing less concurrency.