3 ms·
For fast inference, the HuggingFace cofounder, Thom Wolf recommends their text-generation-inference library https://github.com/huggingface/text-generation-infer
by convexstrictly 3y ago
For fast inference, the HuggingFace cofounder, Thom Wolf recommends their text-generation-inference library https://github.com/huggingface/text-generation-inference https://github.com/huggingface/text-generation-inference
https://twitter.com/Thom_Wolf/status/1664613366751526914 https://twitter.com/Thom_Wolf/status/1664613366751526914