4 ms·
Layer Skip: Enabling Early Exit Inference and Self-Speculative Decoding
- melhoushi 2y agoHi, author here! Thanks so much for sharing. I have created a thread on X with a brief explanation of the paper: https://twitter.com/m_elhoushi/status/1783800052986655203 https://twitter.com/m_elhoushi/status/1783800052986655203 Happy to answer any questions.