2 ms·
Show HN: HW/SW co-design blueprint for fault recovery in LLM training
- PJHkorea 2mo agoIf you have ever experienced a device failure during distributed LLM training, you know the feeling of just wanting to climb into a coffin. To solve this nightmare even just a little bit, I put together this blueprint.