See also speculative cascades which is a nice read and furthered my understanding of how it all works https://research.google/blog/speculative-cascades-a-hybri

See also speculative cascades which is a nice read and furthered my understanding of how it all works https://research.google/blog/speculative-cascades-a-hybrid-approach-for-smarter-faster-llm-inference/ https://research.google/blog/speculative-cascades-a-hybrid-a...