https://fergusfinn.com/blog/economics-of-speculative-decoding/#the-moe-roofline https://fergusfinn.com/blog/economics-of-speculative-decodin... good point tho

https://fergusfinn.com/blog/economics-of-speculative-decoding/#the-moe-roofline https://fergusfinn.com/blog/economics-of-speculative-decodin... good point tho - plus for Deepseek the shared expert increases the overlap slightly