3 ms·

How much memory would inference take on this type of model? What's the impact of it being an MoE architecture?