3 ms·

Is CUDA still a moat? Are we not at the point where frontier models can reimplement software stacks, given you throw enough tokens at the problem.

vatsachak 2mo ago
You just proved that AI cannot currently do that
- incrudible 2mo ago
  It can definitely create a software stack for you if you hold it right, but the software stack supported by a trillion dollar company with decades of expertise, that also uses AI to improve its stack is probably gonna be better.
  - tomrod 2mo ago
    On the reverse side, there are fundamental limits to the number of ways you can perform certain actions, and agents are both diligent as well as able to swarm. If you have your tests beforehand, there is a chance.
alightsoul 2mo ago
if you are developing your own hardware, you provide your own stack to avoid lawsuits with nvidia. i don't think it's a technical problem at all, but a legal one. this is probably why zluda was scrapped by AMD and Intel. Nvidia technically bans the creation of CUDA reimplementations in their TOS if i remember correctly
- zarzavat 2mo ago
  Doesn't Google v Oracle provide protection here? Copying APIs is fair use. If it's patents that are the problem then presumably all these large semiconductor companies have defensive parent portfolios.
  - alightsoul 2mo ago
    I don't know then, amd and Intel decided to get rid of Zluda before that lawsuit ruled that apis are fair use. And now, their cloud customers are ok with using their own stack such as rocm, and Intel got rid of their Garuda ai chips. Those things also happened before the lawsuit was settled It would be a breach of contract not a copyright issue.
- sreekanth850 2mo ago
  [flagged]
fooker 2mo ago
If you are making a decision to spend 50B on hardware, would you use the proven tech stack or rely on engineers taking an unspecified amount of time vibecoding your software stack while the hardware sits idle? How about in a month or so when you have to run a slightly different workload?
- epolanski 2mo ago
  Hyper scalers like Google or Microsoft, which are the big spenders, have all the incentives in the world to get more out of their gargantuan spending. In fact both of them, actually Amazon too, invest in their own inference hardware and owns the stack. You can't possibly think that these companies will keep shelling 50-100B per year in hardware alone where 60%+ is margin for Nvidia and not invest there.
aurareturn 2mo ago
You still need experts to know what is good and what is not.
someothherguyy 2mo ago
i haven't seen it. see the recent browser attempts.

vatsachak 2mo ago

You just proved that AI cannot currently do that

incrudible 2mo ago
It can definitely create a software stack for you if you hold it right, but the software stack supported by a trillion dollar company with decades of expertise, that also uses AI to improve its stack is probably gonna be better.
- tomrod 2mo ago
  On the reverse side, there are fundamental limits to the number of ways you can perform certain actions, and agents are both diligent as well as able to swarm. If you have your tests beforehand, there is a chance.

alightsoul 2mo ago

if you are developing your own hardware, you provide your own stack to avoid lawsuits with nvidia. i don't think it's a technical problem at all, but a legal one. this is probably why zluda was scrapped by AMD and Intel. Nvidia technically bans the creation of CUDA reimplementations in their TOS if i remember correctly

zarzavat 2mo ago
Doesn't Google v Oracle provide protection here? Copying APIs is fair use. If it's patents that are the problem then presumably all these large semiconductor companies have defensive parent portfolios.
- alightsoul 2mo ago
  I don't know then, amd and Intel decided to get rid of Zluda before that lawsuit ruled that apis are fair use. And now, their cloud customers are ok with using their own stack such as rocm, and Intel got rid of their Garuda ai chips. Those things also happened before the lawsuit was settled It would be a breach of contract not a copyright issue.
sreekanth850 2mo ago
[flagged]

fooker 2mo ago

If you are making a decision to spend 50B on hardware, would you use the proven tech stack or rely on engineers taking an unspecified amount of time vibecoding your software stack while the hardware sits idle? How about in a month or so when you have to run a slightly different workload?

epolanski 2mo ago
Hyper scalers like Google or Microsoft, which are the big spenders, have all the incentives in the world to get more out of their gargantuan spending. In fact both of them, actually Amazon too, invest in their own inference hardware and owns the stack. You can't possibly think that these companies will keep shelling 50-100B per year in hardware alone where 60%+ is margin for Nvidia and not invest there.

aurareturn 2mo ago

You still need experts to know what is good and what is not.

someothherguyy 2mo ago

i haven't seen it. see the recent browser attempts.