4 ms·Except, their benchmarking shows this can speed up time to first token by up to 10%.by antonvs 3mo agoExcept, their benchmarking shows this can speed up time to first token by up to 10%.