3 ms·
Maybe, but GPU is just one aspect of NVIDIA's dominance. If you are buying Vera Rubin GPUs, you're getting an NVL72 rack, which is only one of several racks th
by eitally 2mo ago
Maybe, but GPU is just one aspect of NVIDIA's dominance. If you are buying Vera Rubin GPUs, you're getting an NVL72 rack, which is only one of several racks that you're probably buying. You'll also need your NVIDIA racks with NVIDIA networking & storage gear, too. At the end of the day, they're "vertically integrated" for your accelerated computing data center (e.g. the "AI Factory"). This doesn't even count the software layer, where CUDA + CUDA-X (not to mention the software for all the sysadmin pieces) has a huge first mover advantage over anyone else.
- zarzavat 1mo agoIs CUDA still a moat? Are we not at the point where frontier models can reimplement software stacks, given you throw enough tokens at the problem.
- vatsachak 1mo agoYou just proved that AI cannot currently do that
- incrudible 1mo agoIt can definitely create a software stack for you if you hold it right, but the software stack supported by a trillion dollar company with decades of expertise, that also uses AI to improve its stack is probably gonna be better.
- tomrod 1mo agoOn the reverse side, there are fundamental limits to the number of ways you can perform certain actions, and agents are both diligent as well as able to swarm. If you have your tests beforehand, there is a chance.
- alightsoul 1mo agoif you are developing your own hardware, you provide your own stack to avoid lawsuits with nvidia. i don't think it's a technical problem at all, but a legal one. this is probably why zluda was scrapped by AMD and Intel. Nvidia technically bans the creation of CUDA reimplementations in their TOS if i remember correctly
- zarzavat 1mo agoDoesn't Google v Oracle provide protection here? Copying APIs is fair use. If it's patents that are the problem then presumably all these large semiconductor companies have defensive parent portfolios.
- alightsoul 1mo agoI don't know then, amd and Intel decided to get rid of Zluda before that lawsuit ruled that apis are fair use. And now, their cloud customers are ok with using their own stack such as rocm, and Intel got rid of their Garuda ai chips. Those things also happened before the lawsuit was settled It would be a breach of contract not a copyright issue.
- sreekanth850 1mo ago[flagged]
- fooker 1mo agoIf you are making a decision to spend 50B on hardware, would you use the proven tech stack or rely on engineers taking an unspecified amount of time vibecoding your software stack while the hardware sits idle? How about in a month or so when you have to run a slightly different workload?
- epolanski 1mo agoHyper scalers like Google or Microsoft, which are the big spenders, have all the incentives in the world to get more out of their gargantuan spending. In fact both of them, actually Amazon too, invest in their own inference hardware and owns the stack. You can't possibly think that these companies will keep shelling 50-100B per year in hardware alone where 60%+ is margin for Nvidia and not invest there.
- aurareturn 1mo agoYou still need experts to know what is good and what is not.
- someothherguyy 1mo agoi haven't seen it. see the recent browser attempts.