3 ms·Thats a huge tok/sec. Prompt prefill is the bottleneckby brcmthrowaway 2mo agoThats a huge tok/sec. Prompt prefill is the bottleneck