3 ms·
I forgot to clarify dealing with the network bottleneck
by TYMorningCoffee 1y ago
I forgot to clarify dealing with the network bottleneck
- moralestapia 1y agoJust my two cents from experience, any sufficiently advanced LLM training or inference pipeline eventually figures out that the real bottleneck is the network!