6 ms·

This right here. Until Intel (and/or AMD) get serious about the software side and actually invest the money CUDA isn't going anywhere. Intel will make noises ab

This right here. Until Intel (and/or AMD) get serious about the software side and actually invest the money CUDA isn't going anywhere. Intel will make noises about various initiatives in that direction and then a quarter or two later they'll make big cuts in those divisions. They need to make a multi-year commitment and do some serious hiring (and they'll need to raise their salaries to market rates to do this) if they want to play in the CUDA space.

latchkey 3y ago
Literally, every single announcement (and action) coming out of AMD these days is that they are serious about the software. I don't see any reason at this point to doubt them. The larger issue is that they need to fix the access to their high end GPUs. You can't rent a MI250... or even a MI300x (yet, I'm working on that myself!). But that said, you can't rent an H100 either... there are none available.
- _7il4 3y ago
  <removed>
  - latchkey 3y ago
    ROCm is open source. and: https://www.youtube.com/watch?v=pVl25BbczLI https://www.youtube.com/watch?v=pVl25BbczLI
    - deleted 3y ago
      [deleted]
  - mepian 3y ago
    How’s SYCL proprietary exactly?
  - latchkey 3y ago
    What _7il4 removed were these two comments: "AMD is not serious, and neither is Intel for that matter. Their software are piles of proprietary garbage fires. They may say they are serious but literally nothing indicates they are." "Yes, and ROCm also doesn't work on anything non-AMD. In fact it doesn't even work on all recent AMD gpus. T"
    - frognumber 3y ago
      It's not too polite to repost what people removed. Errors on the internet shouldn't haunt people forever. However, my experience is that the comments about AMD are spot-on, with the exception of the word "proprietary." Intel hasn't gotten serious yet, and has a good track record in other domains (compilers, numerical libraries, etc.). They've been flailing for a while, but I'm curious if they'll come up with something okay.
      - latchkey 3y ago
        Normally, I wouldn't do that, but this time I felt like both comments were intentionally inflammatory and then the context for my response was lost. "literally nothing" is also wrong given that they just had a large press announcement on Dec 6th (yt as part of my response below), where they spent 2 hours saying (and showing) they are serious. The second comment was made and then immediately deleted, in a way that was to send me a message directly. It is what irked me enough to post their comments back.
        _7il4 3y ago
        I deleted it because I was in an extremely bad mood and later realized it was simply wrong of me to post it and vent my unrelated frustration in those comments. I think it's in extremely bad taste to repost what I wrote when I made the clear choice to delete it.
        FeepingCreature 3y ago
        If you didn't say it, the rocks would cry out. Personally, I'll believe AMD is maybe serious about Rocm if they make it a year without breaking their Debian repository.
- lmm 3y ago
  > Literally, every single announcement (and action) coming out of AMD these days is that they are serious about the software. I don't see any reason at this point to doubt them. They're having to announce it so much because people are rightly sceptical. Talk is cheap, and their software has sucked for years. Have they given concrete proof of their commitment, e.g. they've spent X dollars or hired Y people to work on it (or big names Z and W)?
  - latchkey 3y ago
    Agreed. Time will tell. MI300x and ROCm 6 and their support of projects like Pytorch, are all good steps in the right direction. HuggingFace now supports ROCm.
  - deleted 3y ago
    [deleted]
- DeathArrow 3y ago
  >Literally, every single announcement (and action) coming out of AMD these days is that they are serious about the software. I don't see any reason at this point to doubt them. I have a bridge to sell.
  - 65a 3y ago
    It is way, way better in the last year or so. Perfectly reasonable cards for inference if you actually understand the stack and know how to use it. Is nVidia faster? Sure, but at twice the price for 20-30% gains. If that makes sense for you, keep paying the tax.
    - latchkey 3y ago
      Not just tax, but fighting with centralization on a single provider and subsequent unavailability.
viewtransform 3y ago
AMD made a presentation on their AI software strategy at Microsoft Ignite two weeks ago. Worth a watch for the slides and live demo https://youtu.be/7jqZBTduhAQ?t=61 https://youtu.be/7jqZBTduhAQ?t=61

latchkey 3y ago

Literally, every single announcement (and action) coming out of AMD these days is that they are serious about the software. I don't see any reason at this point to doubt them. The larger issue is that they need to fix the access to their high end GPUs. You can't rent a MI250... or even a MI300x (yet, I'm working on that myself!). But that said, you can't rent an H100 either... there are none available.

_7il4 3y ago
<removed>
- latchkey 3y ago
  ROCm is open source. and: https://www.youtube.com/watch?v=pVl25BbczLI https://www.youtube.com/watch?v=pVl25BbczLI
  - deleted 3y ago
    [deleted]
- mepian 3y ago
  How’s SYCL proprietary exactly?
- latchkey 3y ago
  What _7il4 removed were these two comments: "AMD is not serious, and neither is Intel for that matter. Their software are piles of proprietary garbage fires. They may say they are serious but literally nothing indicates they are." "Yes, and ROCm also doesn't work on anything non-AMD. In fact it doesn't even work on all recent AMD gpus. T"
  - frognumber 3y ago
    It's not too polite to repost what people removed. Errors on the internet shouldn't haunt people forever. However, my experience is that the comments about AMD are spot-on, with the exception of the word "proprietary." Intel hasn't gotten serious yet, and has a good track record in other domains (compilers, numerical libraries, etc.). They've been flailing for a while, but I'm curious if they'll come up with something okay.
    - latchkey 3y ago
      Normally, I wouldn't do that, but this time I felt like both comments were intentionally inflammatory and then the context for my response was lost. "literally nothing" is also wrong given that they just had a large press announcement on Dec 6th (yt as part of my response below), where they spent 2 hours saying (and showing) they are serious. The second comment was made and then immediately deleted, in a way that was to send me a message directly. It is what irked me enough to post their comments back.
      - _7il4 3y ago
        I deleted it because I was in an extremely bad mood and later realized it was simply wrong of me to post it and vent my unrelated frustration in those comments. I think it's in extremely bad taste to repost what I wrote when I made the clear choice to delete it.
        FeepingCreature 3y ago
        If you didn't say it, the rocks would cry out. Personally, I'll believe AMD is maybe serious about Rocm if they make it a year without breaking their Debian repository.
lmm 3y ago
> Literally, every single announcement (and action) coming out of AMD these days is that they are serious about the software. I don't see any reason at this point to doubt them. They're having to announce it so much because people are rightly sceptical. Talk is cheap, and their software has sucked for years. Have they given concrete proof of their commitment, e.g. they've spent X dollars or hired Y people to work on it (or big names Z and W)?
- latchkey 3y ago
  Agreed. Time will tell. MI300x and ROCm 6 and their support of projects like Pytorch, are all good steps in the right direction. HuggingFace now supports ROCm.
- deleted 3y ago
  [deleted]
DeathArrow 3y ago
>Literally, every single announcement (and action) coming out of AMD these days is that they are serious about the software. I don't see any reason at this point to doubt them. I have a bridge to sell.
- 65a 3y ago
  It is way, way better in the last year or so. Perfectly reasonable cards for inference if you actually understand the stack and know how to use it. Is nVidia faster? Sure, but at twice the price for 20-30% gains. If that makes sense for you, keep paying the tax.
  - latchkey 3y ago
    Not just tax, but fighting with centralization on a single provider and subsequent unavailability.

viewtransform 3y ago

AMD made a presentation on their AI software strategy at Microsoft Ignite two weeks ago. Worth a watch for the slides and live demo https://youtu.be/7jqZBTduhAQ?t=61 https://youtu.be/7jqZBTduhAQ?t=61