3 ms·5x Faster Time to First Token with Nvidia TensorRT-LLM KV Cache Early Reuse2 points by sandwichsphinx 2y ago