3 ms·
Isn't FasterTransformer (NVidia, OSS) and text-generation-inference (Huggingface, not OSS) are faster than this?
by ipsum2 3y ago
Isn't FasterTransformer (NVidia, OSS) and text-generation-inference (Huggingface, not OSS) are faster than this?
loading thread…