4 ms·
Those are all impressive numbers, but did they actually fix their software stack? Are there people here that have actually trained with those and if so how was
by belval 3y ago
Those are all impressive numbers, but did they actually fix their software stack? Are there people here that have actually trained with those and if so how was the experience?
I'm genuinely curious because it seems like every other AI Accelerator/GPU thread on HN mentions MI300X, yet I haven't talked to/met anyone who trained anything with AMD.
- latchkey 3y agoThe MI300x aren't released yet, that's why it isn't popular. Azure is building a cloud [0]. I know someone else personally who's building a cloud too. As for training, it has been happening a bit on MI250's [1]. There is also A LOT that happens that doesn't make the larger news [2] and [3] and [4]. [0] https://techcommunity.microsoft.com/t5/azure-high-performance-computing/azure-announces-new-ai-optimized-vm-series-featuring-amd-s/ba-p/3980770 https://techcommunity.microsoft.com/t5/azure-high-performanc... [1] https://www.databricks.com/blog/training-llms-scale-amd-mi250-gpus https://www.databricks.com/blog/training-llms-scale-amd-mi25... [2] https://www.amd.com/en/resources/case-studies/kt-cloud.html https://www.amd.com/en/resources/case-studies/kt-cloud.html [3] https://www.lamini.ai/blog/lamini-llm-finetuning-on-amd-rocm-a-technical-recipe https://www.lamini.ai/blog/lamini-llm-finetuning-on-amd-rocm... [4] https://twitter.com/cHHillee/status/1730293330213531844 https://twitter.com/cHHillee/status/1730293330213531844
- latchkey 3y agohttps://news.ycombinator.com/item?id=38479616 https://news.ycombinator.com/item?id=38479616