4 ms·
Hmm, no mention of Megatron in their timeline? https://nv-adlr.github.io/MegatronLM https://nv-adlr.github.io/MegatronLM
by lucidrains 7y ago
Hmm, no mention of Megatron in their timeline? https://nv-adlr.github.io/MegatronLM https://nv-adlr.github.io/MegatronLM
- ivalm 7y agoThey do mention the 8b+ "GPT-2" model trained by nVidia. Which is their reference to megatron.
- lucidrains 7y agoOh! You are right! How did I miss that..