11 ms·
Intel Gaudi 3 the New 128GB HBM2e AI Chip in the Wild
- 2genders16444 3y ago[flagged]
- SEXMCNIGGA12227 3y ago[dead]
- SEXMCNIGGA10574 3y ago[flagged]
- SEXMCNIGGA43970 3y ago[flagged]
- SEXMCNIGGA41868 3y ago[flagged]
- 2genders41030 3y ago[dead]
- 2genders21790 3y ago[flagged]
- sexmc24167 3y ago[flagged]
- sexmc46980 3y ago[flagged]
- BreakKunt 3y agoNVDA customers are willing to pay to much for AI chips so they get the money back and more from the pumped up NVDA stock price . This is inflationary and we are still stuck with high interest rates because of those schmucks!
- deleted 3y ago[deleted]
- SEXMCNIGGA13047 3y ago[flagged]
- deleted 3y ago[deleted]
- _ea1k 3y agoSo, where can I use instances of Gaudi 3 and what is the hourly price for these instances?
- sidkashyap 3y agohttps://www.intel.com/content/www/us/en/developer/tools/devcloud/services.html https://www.intel.com/content/www/us/en/developer/tools/devc...
- latchkey 3y agoThis is something I'd like to offer via my business (Hot Aisle) at some point in the near future. Right now, we are just getting started and focused on MI300x, but the long term goal is to offer any type of high end compute that people are willing to rent.
- alchemist1e9 3y agoI’m interested and have questions, but https://www.hotaisle.xyz/ https://www.hotaisle.xyz/ doesn’t exactly provide a lot of answers.
- latchkey 3y agoSorry about that. We are just getting started, so the lowest priority right now is the website. Additionally, due to the KYC requirements around these GPUs (due to US export controls), we really want to get to know our customers first. Feel free to ping me on email and happy to get on a call and talk more.
- CapeTheory 3y agoWhat USP are you aiming for, to differentiate from the many companies who have tried and failed to offer some form of HPCaaS over the last 10-15 years?
- latchkey 3y agoGreat question! I'm going to answer it the only way I know how... with a bit of a story of the history of things. Sorry if this bores you. The problem I realized over a year ago was that nobody had hourly rental access to high end AMD GPUs. In addition, access to high end Nvidia was equally difficult. I signed up for a CoreWeave account, put in my credit card and was told a few weeks later that my account was not approved. In effect, the only way to get access to super high end compute, was to be involved in HPC and that requires connections. At the time, we also didn't even know if AMD was going to seriously adopt AI as a strategy. My view was that there were actually two problems, lack of general access and that everyone was putting all their eggs into a single basket. Mostly because of that lack of access, and because AMD was lacking a great developer flywheel story. I spent August to December building a business plan, closing funding, forming the business, hiring my co-founder full time, securing data center space, securing direct relationships with vendors, and designing the system we were going to deploy. There are a million other little details in there, but this is long enough as it is. Oct/Nov of last year rolls around and suddenly AMD has changed their tune. Lisa Su doubles down. Dec 6th, MI300x rolls out. We made our first PoC order in January, received it in March. It just goes to show how cutting edge and how long all of this takes. 3 more small (not hyperscaler) businesses sprung up during that time, all offering effectively the same product. We went to the data center, deployed our PoC and about 2 weeks later, we had our first customer onboarded. I call all of that validation, and was able to secure further funding based on it. To answer your question, I'm not sure that I need a specific USP. The demand for compute isn't going down. If I have a product that people want, and I can offer them ethical, honest, truthful, great service around that product. All based on decades of experience. Can't that be enough? Myself and my investors believe so.
- loudmax 3y agoThe "in the wild" part of the title is misleading. These chips are being presented in a very controlled environment. An interesting aspect of Intel's design is they use Ethernet for connectivity. If they can get the performance on par with NVLink, that by itself could be a win because everybody knows how to manage Ethernet. Very few people know how to manage an NVLink network. To be clear, this is data center hardware. The lower power versions of these cards consume like 600W, and no mention in the article on pricing.
- benreesman 3y agoI agree that it’s misleading to act like this is a product in market, we don’t really even know if the yield will happen. But it’s a serious thing if it happens.
- foobiekr 3y agoVery few people actually know how to provision and manage a lossless Ethernet fabric and I’d wager someone who had literally never touched infiniband would have an easier time accomplishing it from zero with IB than with Ethernet on real vendor gear. Ethernet has so, so many gotchas. Maybe if it was a layer 3 only network it would work. Maybe.
- alfalfasprout 3y agoI'm guessing it's RDMA over ethernet too which often has a lot of gotchas depending on the exact hardware being used.
- epistasis 3y agoIronically enough, since NVIDIA bought Mellanox, it's likely that the best documented route to get ROCE v2 going is with switches purchased from NVIDIA... Edit: and yes, it's RDMA over ethernet https://docs.habana.ai/en/latest/Gaudi_Overview/Gaudi_Architecture.html https://docs.habana.ai/en/latest/Gaudi_Overview/Gaudi_Archit...
- dogma1138 3y ago
- 1024core 3y agoAbout time. NVIDIA needs some serious competition.
- talldayo 3y agopokes OpenCL's corpse with a stick C'mon, do something...
- ein0p 3y agoIronically, Transformers are relatively simple architectures - all you really need is a high performance matmul. So OpenCL could "do something" at this point, if it were alive.
- imtringued 3y agohttps://github.com/ROCm/ROCm/issues/2754 https://github.com/ROCm/ROCm/issues/2754 Wow and I thought that the latest generation of GPUs was better.
- anakaine 3y agoFrom that exchange, clearly not. They do not have their stuff together. This is one area where AMD really should be employing quite a full team to ensure that major projects, including drivers, are able to support AMD cards without any friction. Whilst it's still a PITA to work.with AMD hardware in most AI frameworks Nvidia will continue to dominate.
- anakaine 3y agoIts very unfortunate. One of our vendors has spent a hell of an effort making spatial analysis tools work via OpenCL instead of being just processor bound, and its made those industry standard libraries 1-2 orders of magnitude faster. That is something the spatial industry desperately needs in order to improve iteratively. With the state of OpenCL it's frustrating. So much to be had, but so little improvement and support.
- 3y ago
- SEXMCNIGGA25207 3y ago[flagged]
- SEXMCNIGGA46389 3y ago[dead]
- SEXMCNIGGA168 3y ago[flagged]
- SEXMCNIGGA43116 3y ago[flagged]
- SEXMCNIGGA19716 3y ago[flagged]
- SEXMCNIGGA48726 3y ago[flagged]
- SEXMCNIGGA5221 3y ago[flagged]
- SEXMCNIGGA40360 3y ago[flagged]
- SEXMCNIGGA21365 3y ago[flagged]
- SEXMCNIGGA15547 3y ago[flagged]
- SEXMCNIGGA16269 3y ago[flagged]
- SEXMCNIGGA35650 3y ago[flagged]
- SEXMCNIGGA40482 3y ago[flagged]
- SEXMCNIGGA16786 3y ago[flagged]
- SEXMCNIGGA4263 3y ago[flagged]
- SEXMCNIGGA15235 3y ago[flagged]
- SEXMCNIGGA23991 3y ago[flagged]
- SEXMCNIGGA4315 3y ago[flagged]
- SEXMCNIGGA2000 3y ago[flagged]
- SEXMCNIGGA9235 3y ago[flagged]
- SEXMCNIGGA25371 3y ago[flagged]
- SEXMCNIGGA13007 3y ago[flagged]
- SEXMCNIGGA14609 3y ago[flagged]
- SEXMCNIGGA48800 3y ago[flagged]
- SEXMCNIGGA24155 3y ago[flagged]
- SEXMCNIGGA39372 3y ago[flagged]
- SEXMCNIGGA48330 3y ago[flagged]
- SEXMCNIGGA34830 3y ago[flagged]
- SEXMCNIGGA39111 3y ago[flagged]
- SEXMCNIGGA41122 3y ago[flagged]
- SEXMCNIGGA15146 3y ago[flagged]
- SEXMCNIGGA6667 3y ago[flagged]
- SEXMCNIGGA5849 3y ago[flagged]
- SEXMCNIGGA8548 3y ago[flagged]
- SEXMCNIGGA16891 3y ago[flagged]
- SEXMCNIGGA30683 3y ago[flagged]
- SEXMCNIGGA31501 3y ago[flagged]
- SEXMCNIGGA48170 3y ago[flagged]
- SEXMCNIGGA38026 3y ago[flagged]
- SEXMCNIGGA28970 3y ago[dead]
- SEXMCNIGGA37282 3y ago[flagged]
- SEXMCNIGGA23749 3y ago[flagged]
- SEXMCNIGGA26559 3y ago[dead]
- SEXMCNIGGA13978 3y ago[dead]
- SEXMCNIGGA27381 3y ago[dead]
- SEXMCNIGGA38697 3y ago[dead]
- SEXMCNIGGA45452 3y ago[flagged]
- SEXMCNIGGA48490 3y ago[flagged]
- SEXMCNIGGA40982 3y ago[dead]
- SEXMCNIGGA20634 3y ago[dead]
- SEXMCNIGGA9937 3y ago[dead]
- SEXMCNIGGA16795 3y ago[dead]
- SEXMCNIGGA15734 3y ago[dead]
- SEXMCNIGGA4681 3y ago[flagged]
- SEXMCNIGGA19790 3y ago[dead]
- SEXMCNIGGA17383 3y ago[dead]
- SEXMCNIGGA44486 3y ago[dead]
- SEXMCNIGGA5591 3y ago[dead]
- SEXMCNIGGA4183 3y ago[flagged]
- SEXMCNIGGA15327 3y ago[flagged]
- SEXMCNIGGA1870 3y ago[flagged]
- SEXMCNIGGA43309 3y ago[flagged]
- SEXMCNIGGA2890 3y ago[dead]
- SEXMCNIGGA15176 3y ago[dead]
- SEXMCNIGGA49665 3y ago[dead]
- SEXMCNIGGA44404 3y ago[dead]
- 2genders43127 3y ago[dead]
- 2genders1881 3y ago[dead]
- 2genders5738 3y ago[dead]
- 2genders38896 3y ago[dead]
- 2genders45256 3y ago[flagged]
- 2genders14231 3y ago[flagged]
- 2genders17454 3y ago[flagged]
- 2genders35412 3y ago[flagged]
- seventytwo 3y agoWhat are the row of green rectangles in the middles of the longe edges?
- 2genders5827 3y ago[dead]
- 2genders8873 3y ago[dead]
- 2genders14206 3y ago[flagged]
- 2genders36371 3y ago[flagged]
- 2genders21790 3y ago[flagged]
- 2genders17675 3y ago[flagged]
- 2genders2082 3y ago[flagged]
- 2genders25672 3y ago[flagged]
- 2genders11504 3y ago[flagged]
- SEXMCNIGGA47195 3y ago[dead]
- 2genders44876 3y ago[dead]
- 2genders2516 3y ago[flagged]
- 2genders9902 3y ago[flagged]
- SEXMCNIGGA12976 3y ago[dead]
- 2genders11504 3y ago[flagged]
- 2genders36126 3y ago[flagged]
- 2genders20995 3y ago[flagged]
- 2genders18584 3y ago[flagged]
- 2genders20183 3y ago[dead]
- 2genders24665 3y ago[flagged]
- 2genders8651 3y ago[flagged]
- 2genders3648 3y ago[flagged]
- 2genders895 3y ago[flagged]
- 2genders42789 3y ago[flagged]
- 2genders3253 3y ago[dead]
- 2genders1206 3y ago[flagged]
- 2genders8120 3y ago[flagged]
- 2genders35499 3y ago[flagged]
- 2genders47148 3y ago[flagged]
- SEXMCNIGGA5962 3y ago[dead]
- SEXMCNIGGA41871 3y ago[dead]
- SEXMCNIGGA12298 3y ago[dead]
- SEXMCNIGGA10372 3y ago[dead]
- SEXMCNIGGA21585 3y ago[dead]
- SEXMCNIGGA4848 3y ago[dead]
- 2genders28876 3y ago[dead]
- SEXMCNIGGA8890 3y ago[dead]
- indianmilf4469 3y ago[dead]
- indianmilf19397 3y ago[dead]
- indianmilf49034 3y ago[dead]
- indianmilf21791 3y ago[dead]
- sexmc23532 3y ago[flagged]
- sexmc35749 3y ago[flagged]
- sexmc16684 3y ago[flagged]
- sexmc16524 3y ago[flagged]
- sexmc20075 3y ago[flagged]
- sexmc9352 3y ago[dead]
- sexmc3279 3y ago[flagged]