2 ms·Are you using batch size 1 with LLMs? Larger batch sizes get much higher utilization.by modeless 3y agoAre you using batch size 1 with LLMs? Larger batch sizes get much higher utilization.