Sounds like speculative decoding. https://huggingface.co/blog/vivien/optimal-lossy-variant-of-speculative-decoding https://huggingface.co/blog/vivien/optimal-l

Sounds like speculative decoding. https://huggingface.co/blog/vivien/optimal-lossy-variant-of-speculative-decoding https://huggingface.co/blog/vivien/optimal-lossy-variant-of-...