3 ms·The benchmark comparison is against the dense variants not MoEby Havoc 2mo agoThe benchmark comparison is against the dense variants not MoE