3 ms·

I assume it’s time to first output token so it’s basically throughput. How fast can it output 8001 tokens