3 ms·
Have you tried to run GPT-OSS-120b using TRT-LLM (as you hint NVIDIA probably did it for their benchmark)? https://cookbook.openai.com/articles/gpt-oss/run-nvi
by renaudr 11mo ago
Have you tried to run GPT-OSS-120b using TRT-LLM (as you hint NVIDIA probably did it for their benchmark)?
https://cookbook.openai.com/articles/gpt-oss/run-nvidia https://cookbook.openai.com/articles/gpt-oss/run-nvidia
- EnPissant 11mo agoDid Nvidia release benchmark numbers for this?