2 ms·
I think speculative decoding eliminates a lot of the savings people imagine they're getting from making LLMs use strange languages.
by mike_hearn 7mo ago
I think speculative decoding eliminates a lot of the savings people imagine they're getting from making LLMs use strange languages.