4 ms·
AMD's Response to Nvidia regarding H100 vs. MI300X on real world workloads
- vitus 3y agoI believe this is the referenced Nvidia blog post, for context (since AMD's post doesn't seem to link to it): https://developer.nvidia.com/blog/achieving-top-inference-performance-with-the-nvidia-h100-tensor-core-gpu-and-nvidia-tensorrt-llm/ https://developer.nvidia.com/blog/achieving-top-inference-pe...
- magicalhippo 3y agoOriginal title is "Competitive performance claims and industry leading Inference performance on AMD Instinct MI300X" Looking good for AMD, not that it matters to me since they're both way outta my league.
- dylan604 3y agoThis is how I feel watching those shows listing all of the stats on super cars. Yes, they're fast and they're pretty, but I'll never afford one, so learning the inner details is lost effort on me
- unixfg 3y agoI'm hoping to buy a used 'super car'
- dylan604 3y agoIs that allowed? I assumed that they wouldn't allow you to sell it. I guess they want to have their own Certified pre-owned side of the show room?
- topkai22 3y agoThe horrible concept the a “sale” is only a revocable license hasn’t spread to cars too much yet. There is a robust trade in high end used cars via private parties and specialists - you can just look at eBay motors for plenty of examples. https://www.ebay.com/itm/296067000770?hash=item44eef7e9c2%3Ag%3AIZEAAOSwa%7EllMZfO&amdata=enc%3AAQAIAAAAwINPxMMUH7M%2Brw88gENnp5sODxvHeY5L%2B0BLYpyZ%2B0XSNnTLEXNzD0SZR%2B%2BVDKhYXFkhwMZPOei1Np2uIafeMRsN%2BoIqo7Qimvu9Vh%2FCfkW0yT80tqJz4w2G4wc%2BuS83bcXAX9qaVwZX1aq81oQFqt%2F1YbnMeQrRcW3UR%2BEm1JGmpZaoF0nX3lGaV7o%2F%2BvetKhu4Xkwa0RL1mmo06dQpqxKGi1T5zNYmt2aidV67aVIz9viVkLhtOo8nJx4wEdDE8A%3D%3D%7Ctkp%3ABk9SR6zm3OWOYw&LH_ItemCondition=3000%7C1000%7C2500 https://www.ebay.com/itm/296067000770?hash=item44eef7e9c2%3A...
- justinclift 3y agoBear in mind that some of the super car brands do mandate terms like a "right of first refusal" in their favour, giving them the ability to block sales. * https://wheelsonspin.com/rules-for-buying-a-ferrari/ https://wheelsonspin.com/rules-for-buying-a-ferrari/ * https://www.ferrarichat.com/forum/threads/right-of-first-refusal-on-resale.384283/ https://www.ferrarichat.com/forum/threads/right-of-first-ref...
- analognoise 3y agoI think the only car company that I’ve heard of doing something like that is Ferrari, who will ban you for various lengths of time (including for life) from buying another Ferrari.
- slavik81 3y agoIn August, I bought a used server for $1k. It was manufactured in 2017 and it probably cost at least $50k when it was new. Things are expensive when they are new, but everything new will eventually become old.
- huijzer 3y agoCool! What are the specs?
- slavik81 3y agoI purchased two Dell Poweredge C4130 servers with 2x Intel Xeon E5-2697 v4 (18 cores @ 2.3GHz), 128 GiB of RAM @ 2400 MHz, and 2x 2000W PSUs. One with 4x AMD MI25 and one with 2x AMD FirePro S9300 X2. I rounded the cost. It was 2.5k USD for the pair, including shipping. The machines were labelled YETI1 and YETI2. I will have to take good care of them because I think they may have some historic significance. In any case, these machines have a second life as workers for the Debian AI Team CI. More info: https://lists.debian.org/debian-ai/2023/10/msg00009.html https://lists.debian.org/debian-ai/2023/10/msg00009.html
- IshKebab 3y agoIt looks ok for AMD. Trust me a 30% speed advantage is not enough to move the market at all. It's way way easier to tweak your CUDA model to get a 30% speed up than to rewrite it. Maybe if they consistently hold this lead for a decade...
- magicalhippo 3y agoRight, I didn't mean to imply it's earth shattering by any means, but at least they're not hopelessly behind on the hardware side. Software can't magically conjure performance from anemic hardware. That said, software hasn't been AMDs strong side in this arena, so a lot of catching up there as well.
- webaholic 3y agoThis is why we should only trust reviews from reputed independent publications. But good for the market and AMD if these claims are true. Competition breeds innovation.
- musicale 3y agoAgreed - it's great to see AMD actually competing with Nvidia. Everyone will benefit, probably even including Nvidia as well since they can't make enough GPUs to satisfy market demand, and since they may become less likely to rest on their laurels.
- aurareturn 3y agoI love it. They're acknowledging each other. It's going to get petty soon if Nvidia responds to this one.