2 ms·
I haven't had time to follow this thread, but it looks like some people are starting to experimentally replicate DeepSeek on extremely limited H100 training: >
by echelon 2y ago
I haven't had time to follow this thread, but it looks like some people are starting to experimentally replicate DeepSeek on extremely limited H100 training:
> You can RL post-train your small LLM (on simple tasks) with only 10 hours of H100s.
https://www.reddit.com/r/singularity/comments/1i99ebp/well_seems_like_the_cat_is_out_of_the_bag/ https://www.reddit.com/r/singularity/comments/1i99ebp/well_s...
Forgive me if this is inaccurate. I'm rushing around too much this afternoon to dive in.