4 ms·
Is this one of the first LLMs of note that was successfully trained on AMD GPUs? I wonder how seamless the process was and if they faced any issues there.
by mysteria 3y ago
Is this one of the first LLMs of note that was successfully trained on AMD GPUs? I wonder how seamless the process was and if they faced any issues there.
- sanxiyn 3y agoDatabricks (who also participated in OLMo, it's probably the same codebase) trained on AMD before, see 2023 post https://www.databricks.com/blog/amd-mi250 https://www.databricks.com/blog/amd-mi250. It was probably seamless, as any issues were fixed by Databricks in 2023.
- deleted 3y ago[deleted]
- otuutti 3y agohttps://huggingface.co/LumiOpen/Poro-34B https://huggingface.co/LumiOpen/Poro-34B Also fully trained on LUMI. (more models here: https://huggingface.co/LumiOpen https://huggingface.co/LumiOpen)