3 ms·
Yes that's what I mean, speculative decoding does not decrease the performance in terms of quality. I guess my wording was confusing on this.
by albertzeyer 2y ago
Yes that's what I mean, speculative decoding does not decrease the performance in terms of quality. I guess my wording was confusing on this.