3 ms·How big are the active weights? That how much bandwidth you need per second per token.by ryao 2y agoHow big are the active weights? That how much bandwidth you need per second per token.