5 ms·
For context, the submitter of the issue is Anush Elangovan from AMD who's recently been a lot more active on social after the SemiAnalysis article, and taking t
by latchkey 2y ago
For context, the submitter of the issue is Anush Elangovan from AMD who's recently been a lot more active on social after the SemiAnalysis article, and taking the reigns / responsibility of moving AMD's software efforts forward.
However you want to dissect this specific issue, I'd generally consider this a positive step and nice to see it hit the front page.
https://www.reddit.com/r/ROCm/comments/1i5aatx/rocm_feedback_for_amd/ https://www.reddit.com/r/ROCm/comments/1i5aatx/rocm_feedback...
https://www.reddit.com/user/powderluv/ https://www.reddit.com/user/powderluv/
- KeplerBoy 2y agoAlso know as the AMD representative who recently argued with Hotz about supporting tinycorp.
- latchkey 2y agoIs that a bad thing? Good for him to stand up to extortion.
- modeless 2y agoOffering software support in exchange for payment is extortion?
- KeplerBoy 2y agoHard to say from my perspective. I think AMDs offer was fair (full remote access to several test machines), then again just giving tinycorp the boxes on their terms with no strings attached as a kind of research grant would have earned them some goodwill with that corner of the community. Either way both parties will continue making controversial decisions.
- latchkey 2y agoIt isn't hard. We offered as well. Full BIOS access even. Another neocloud, that is funded directly by AMD, also offered to buy him boxes. He refused. It had to come from AMD. That's absurd and extortionist. Long thread here: https://x.com/HotAisle/status/1880467322848137295 https://x.com/HotAisle/status/1880467322848137295
- dhruvdh 2y agoTo add, AMD only makes _parts_ of an MI300X server. It's like asking a tire manufacturer to give you a car for free.
- latchkey 2y agoGreat analogy! Just uploaded some pictures of how complex these machines really are... https://imgur.com/gallery/dell-xe9860-amd-mi300x-bGKyQKr https://imgur.com/gallery/dell-xe9860-amd-mi300x-bGKyQKr
- piskov 2y agoHe explained the reasoning: > Now, why don't they send me the two boxes? I understand when I was asking for firmware to be open sourced that that actually might be difficult for them, but the boxes are on eBay with a simple $$ cost. It was never about the boxes themselves, it was a test to see if software had any budget or power. And they failed super hard
- latchkey 2y ago"and they failed" from his PoV... but not from us looking at things from the other side of the table.
- rikafurude21 2y ago"I estimate having software on par with NVDA would raise their market cap by 100B. Then you estimate what the chance it that @__tinygrad__ can close that gap, say it's 0.1%, probably a very low estimate when you see what we have done so far, but still... That's worth 100M. And they won't even send us 2 ~100k boxes. In what world does that make sense, except in a world where decisions are made based on pride instead of ROI. Culture issue." https://x.com/__tinygrad__/status/1879620242315317304 https://x.com/__tinygrad__/status/1879620242315317304
- AshamedCaptain 2y agoI would really like to see a concrete, legit way to materialize a "100M raise in market cap" into actual ROI ...
- rikafurude21 2y agoWhen the market cap rises, price of shares goes up? Do you know what a market cap is?
- carlmr 2y agoYes, but the company doesn't get more money from that. The only, way to get money out of it is by selling shares at the new price. However it would also raise future revenue, which should be what's reflected by the market. So it would still be something that's good for the company, but not nearly 100B good.
- rikafurude21 2y agoYou dont think AMD being competitive with Nvidia (3,37 trillion USD MC) would be "nearly 100B good"? Believe it or not the only reason thats not the case is good bug-free software. Thats what tinygrad is doing
- carlmr 2y ago
- catgary 2y agoYeah, AMD is already pouring a lot of support into OpenXLA/IREE, which has a lot of well-respected compiler engineers and researchers working on it, and companies like AWS are also investing into it. I don’t really think TinyCorp has anything to offer AMD.
- daguava 2y ago[dead]
- clhodapp 2y agoWhich SemiAnalysis article?
- latchkey 2y agohttps://semianalysis.com/2024/12/22/mi300x-vs-h100-vs-h200-benchmark-part-1-training/ https://semianalysis.com/2024/12/22/mi300x-vs-h100-vs-h200-b...
- magic_at_nodai 2y agohey thats me. Happy to help answer anything here and look forward to your constructive feedback to make AMD software better. We got work to do and look forward to it.
- imtringued 2y agoOk, why does running koboldcpp with a "BLAS Batch Size" of 512 via Vulkan on an RX570 crash my entire computer? You know, to the point where I manually have to turn it on again. I personally couldn't think of a better reason to never buy AMD GPUs ever again by the way.
- latchkey 2y agoI have experience running 130,000 RX470/570/480/580... if you're doing heavy workloads, those things full machine crash if you breathe on them wrong. That said, when they do run, they run extremely well. There is 1000 reasons why your one GPU could have crashed, what does it say in the logs before it crashed?
- saagarjha 2y agoFWIW crashing a machine because of your GPU driver is pretty insane. Why would you want to use a stack like this?