3 ms·
Could these quantized models make MTP (Multi-Token Prediction) significantly faster when used as drafters for larger regular Gemma 4 models?
by somewhatrandom9 4mo ago
Could these quantized models make MTP (Multi-Token Prediction) significantly faster when used as drafters for larger regular Gemma 4 models?
- dist-epoch 4mo agoGoogle already released specialized drafters for Gemma 4.
- Havoc 4mo agoThe E2B ones? Or what do you mean by specialized drafters?
- girvo 4mo agoThe “-assistant” models released by Google are specialised tiny MTP draft models :) 31b-it-assistant is what enables MTP
- int_19h 4mo agoThey have -assistant in the name, so e.g.: https://huggingface.co/google/gemma-4-31B-it-assistant https://huggingface.co/google/gemma-4-31B-it-assistant
- Havoc 4mo agoThanks