2 ms·
In the introduction of the paper it says: "Despite its excellent performance, DeepSeek-V3 requires only 2.788M H800 GPU hours for its full training. In addition
by zardinality 2y ago
In the introduction of the paper it says: "Despite its excellent performance, DeepSeek-V3 requires only 2.788M H800 GPU hours
for its full training. In addition, its training process is remarkably stable. Throughout the entire
training process, we did not experience any irrecoverable loss spikes or perform any rollbacks." They have indeed a very strong infra team.
- deleted 2y ago[deleted]
- ComputerGuru 2y agoDo we have two completely different definitions of “infrastructure”?