2 ms·
It also appears that this was a sampling benchmark...which is not representative. Generation benchmark was 5% faster than SGLang.
by qeternity 1y ago
It also appears that this was a sampling benchmark...which is not representative.
Generation benchmark was 5% faster than SGLang.