3 ms·
8x H200s recommended: https://github.com/sgl-project/sglang/tree/main/benchmark/deepseek_v3 https://github.com/sgl-project/sglang/tree/main/benchmark/de...
by bavell 2y ago
8x H200s recommended:
https://github.com/sgl-project/sglang/tree/main/benchmark/deepseek_v3 https://github.com/sgl-project/sglang/tree/main/benchmark/de...