I understand all that, I am talking about a separate feature that is possibly backported or from llama.cpp. Where you have a small model that runs first and tha

I understand all that, I am talking about a separate feature that is possibly backported or from llama.cpp. Where you have a small model that runs first and that is checked by a large model. I've seen 30%+ speedups using like 1.5B in front of a 15B for example. Two GPUs or more mean you can start to "keep" one or more of the experts hot on a GPU as well.