4 ms·
Exactly, but there is also a rejection sampling based method for speculative sampling: https://arxiv.org/abs/2302.01318 https://arxiv.org/abs/2302.01318
by faabian 2y ago
Exactly, but there is also a rejection sampling based method for speculative sampling: https://arxiv.org/abs/2302.01318 https://arxiv.org/abs/2302.01318