3 ms·
So, there should be something equivalent for Linux right? Ill be thankful to the person that points me to the right github repository, I am new to local LLM.
by temp_user 3y ago
So, there should be something equivalent for Linux right? Ill be thankful to the person that points me to the right github repository, I am new to local LLM.
- alecco 3y agohttps://github.com/NVIDIA/TensorRT-LLM https://github.com/NVIDIA/TensorRT-LLM