3 ms·
If you wanna compare on an h200 and play with trt-llm configs I setup this link here https://brev.nvidia.com/launchable/deploy?launchableID=env-30i1YjHsRWT109H
by alecfong 1y ago
If you wanna compare on an h200 and play with trt-llm configs I setup this link here https://brev.nvidia.com/launchable/deploy?launchableID=env-30i1YjHsRWT109HL6eYxLUeHIwF https://brev.nvidia.com/launchable/deploy?launchableID=env-3...