4 ms·Speculative decoding have higher batch size.by liuliu 3y agoSpeculative decoding have higher batch size.