4 ms·
This is speculative decoding with a n-gram Markov chain instead of a weaker transformer model in the “speculating” position.
by kristjansson 3y ago
This is speculative decoding with a n-gram Markov chain instead of a weaker transformer model in the “speculating” position.
- huevosabio 3y agoThanks, this is a great, succinct way of summarizing the paper.