3 ms·
Why is this even necessary? Can you just shard your training set to the training nodes ahead of time instead?
by WithinReason 2y ago
Why is this even necessary? Can you just shard your training set to the training nodes ahead of time instead?
- wenyuanyu 2y agoNo, besides accessing training data, there is also logging and checkpointing... When you run k8s over it, and there are multiple training jobs... isolated local storage is a nightmare...