3 ms·If you don't have tensor parallelism even 8 x A100 is going to struggle with that kind of model.by imtringued 2y agoIf you don't have tensor parallelism even 8 x A100 is going to struggle with that kind of model.