4 ms·
The thing about 5% gpu utilization makes me wonder if all this talk about training LLMs on multi A100 clusters is largely unecessary and that it might be possib
by naillo 4y ago
The thing about 5% gpu utilization makes me wonder if all this talk about training LLMs on multi A100 clusters is largely unecessary and that it might be possible for everyday GPUs to reach say A100 levels simply by going from 5% utilization to 90%.
- kleinsch 4y agoHe's not literally talking about 5% GPU utilization. It's a metaphor for the eng org being inefficient.