3 ms·
the real question here is whether anybody has gotten cheap, easily available AMD GPUs to run their AI workloads, and if we can predict more people will do so
by yieldcrv 2y ago
the real question here is whether anybody has gotten cheap, easily available AMD GPUs to run their AI workloads, and if we can predict more people will do so
- JonChesterfield 2y agoMicrosoft have their production models running on amdgpu. I doubt it was easy but it's pretty compelling as an existence proof
- anthonix1 2y agoI ported Karparthy's llm.c repo to AMD devices [1], and have trained GPT2 from scratch with 10B tokens of fineweb-edu on a 4x 7900XTX machine in just a few hours (about $2 worth of electricity) [2]. I've also trained the larger GPT2-XL model from scratch on bigger CDNA machines. Works fine. [1] https://github.com/anthonix/llm.c https://github.com/anthonix/llm.c [2] https://x.com/zealandic1 https://x.com/zealandic1