3 ms·It's 8 x A100 for inference. Huggingface has a lot more than 8 A100s.by ilaksh 3y agoIt's 8 x A100 for inference. Huggingface has a lot more than 8 A100s.