I think there is a limit based on MoE number of active parameters and quantisation, bytes count for active experts. But I believe we will see more project like

I think there is a limit based on MoE number of active parameters and quantisation, bytes count for active experts. But I believe we will see more project like this for different models.