4 ms·
If you place experts in different GPUs Right, this is described in the Deepseek V3 paper (section 3.4 on pages 18-20).
by rahimnathwani 2y ago
If you place experts in different GPUs
Right, this is described in the Deepseek V3 paper (section 3.4 on pages 18-20).