3 ms·

What’s the strategy when one does die? It’s just left in place until it’s worth it to pull the entire rack?

• wmf 1y ago
  No. When a single GPU fails it makes the whole 8-GPU server useless so it needs to be swapped promptly.
  • bradleyjg 1y ago
    Interesting. So that implies that all these new data centers are more labor intensive than the pre llm setup which afaik was largely build out and lock the door.