4 ms·
Huggingface TGI supports many models and more than one API: https://huggingface.co/docs/text-generation-inference/en/installation_nvidia https://huggingface.co
by ttyprintk 2y ago
Huggingface TGI supports many models and more than one API:
https://huggingface.co/docs/text-generation-inference/en/installation_nvidia https://huggingface.co/docs/text-generation-inference/en/ins...