3 ms·Agreed, this observation holds true for both decode and prefill. Thanks for sharing the codeby amindiro 10mo agoAgreed, this observation holds true for both decode and prefill. Thanks for sharing the code