4 ms·
Yeah also this CPU user won't utilize it at 100% on 24/7 so it's same efficiency as non-K for most of time.
by fomine3 4y ago
Yeah also this CPU user won't utilize it at 100% on 24/7 so it's same efficiency as non-K for most of time.
- foobiekr 4y agoThe average GPU utilization in AI clusters is nowhere near 100%. More like 15-20% outside of hyperscalers being generous and maybe mid 30% for the hyperscalers for periods of heavy activity. There is way too much gated on data movement at this point. Sure, CXL or other interconnect schemes may help but there are whole-system challenges for scheduling and dependency management and staging that drive these numbers.