3 ms·
In the current era of MoE models, the system RAM memory bandwidth determines your speed more than the GPU does.
by jychang 1y ago
In the current era of MoE models, the system RAM memory bandwidth determines your speed more than the GPU does.
loading thread…