3 ms·
https://github.com/NVIDIA/Megatron-LM https://github.com/NVIDIA/Megatron-LM This is probably a good baseline to start thinking about LLM training at scale.
by spott 2y ago
https://github.com/NVIDIA/Megatron-LM https://github.com/NVIDIA/Megatron-LM
This is probably a good baseline to start thinking about LLM training at scale.