3 ms·
Probably because 8 GPUs is a common setup, and with 8 experts you can put each expert on a different GPU
by wongarsu 3y ago
Probably because 8 GPUs is a common setup, and with 8 experts you can put each expert on a different GPU
loading thread…