3 ms·
Can you use the smaller Gemma 4B model as speculative decoding for the larger 31B model? Why/why not?
by aetherspawn 6mo ago
Can you use the smaller Gemma 4B model as speculative decoding for the larger 31B model?
Why/why not?
- MeetRickAI 6mo ago[dead]