3 ms·
Not dumb at all. It's a whole field of active research - Speculative Decoding. A recent paper goes one level deeper with Speculative Speculative Decoding - http
by anyg 3mo ago
Not dumb at all. It's a whole field of active research - Speculative Decoding.
A recent paper goes one level deeper with Speculative Speculative Decoding - https://arxiv.org/abs/2603.03251 https://arxiv.org/abs/2603.03251
- purple-leafy 3mo agoOh man awesome! I’m so S-M-R-T Compression is such an interesting field
- r-w 3mo agoIs model distillation also related?