3 ms·Yes, and with virtually zero context, which makes an enormous difference for TTFT on the MoE models.by smlacy 6mo agoYes, and with virtually zero context, which makes an enormous difference for TTFT on the MoE models.