4 ms·
What's the best number on vLLM and SGlang so far on H100? It's sad that MLPerf takes a long time to catch up to SOTA models.
by adsharma 1y ago
What's the best number on vLLM and SGlang so far on H100?
It's sad that MLPerf takes a long time to catch up to SOTA models.