3 ms·

Yeah but the issue is that they can make more money if they actually did affordable ML hardware and didn't purposefully gimp the gaming cards. LLms running on

Yeah but the issue is that they can make more money if they actually did affordable ML hardware and didn't purposefully gimp the gaming cards. LLms running on standalone affordable boxes could become a ubiquitous home accessory, not to mention the potential for things like being able to leverage learning from widespread use to retrain the models, like Tesla does with their fleet.

ChuckNorris89 3y ago
>Yeah but the issue is that they can make more money if they actually did affordable ML hardware and didn't purposefully gimp the gaming cards. It's a dick move but it's not illegal (at least not now). Their purpose is to make greater returns for their investors, not make affordable ML hardware for every consumer. >LLms running on standalone affordable boxes could become a ubiquitous home accessory They could be, but why is it Nvidia's fault if they don't happen? They're in the business of making money, not fulfilling dreams, and currently they can barely fulfill their orders for the datacenter customers. Consumers could move the LLM stuff on cheaper Apple HW or Intel or AMD SoCs if they can't outbid the datacenter companies for Nvidia silicone. Seems like a market opening for Nvidia's competitors to price cut them. If they don't exploit it and let Nvidia dominate, it's their fault. It's not Nvidia's fault their competitors were asleep at the wheel since they launched CUDA in 2007 and were helping researchers put their GPUs to use for parallel computing for over 15 years.
- gremlinsinc 3y ago
  If AMD were smart(er), their cpu's are awesome at least... They would team up with intel, google, apple, etc to create a machine learning open cuda alternative, such that all GPU's could essentially be used by ML software equally, I think Nvidia's real hold on AI is that most AI libs use CUDA, and nobody else can really compete when all the tools use X, it's like if firefox launched with their own different HTML syntax because HTML was proprietary, and every other browser did the same thing. Something like chrome : chromium dynamic would work wonders for bringing a sort of standard, not to mention more minds could create better and better implementations.
  - ornitorrincos 3y ago
    They did try, apple made OpenCL and released it to khronos to make a standard, but never got wide support(well, they got plenty of manufacturers on board, not so much users). By that time nvidia already had an advantage with CUDA and their opencl support always lagged.
  - deleted 3y ago
    [deleted]
WheatMillington 3y ago
NVIDIA are not stupid, they understand their marginal revenue and marginal cost analysis, and they obviously decided they're making the most money doing what they're doing. It's asinine to believe we, with access to almost none of the requisite data, could tell NVIDIA how to turn a better profit.
- ActorNightly 3y ago
  >decided they're making the most money doing what they're doing Yes, exactly like all the big tech companies with vast departments for market research that hired a shitload of people, then when economy turned, they started doing layoffs. A.k.a short term profit seeking.

ChuckNorris89 3y ago

>Yeah but the issue is that they can make more money if they actually did affordable ML hardware and didn't purposefully gimp the gaming cards. It's a dick move but it's not illegal (at least not now). Their purpose is to make greater returns for their investors, not make affordable ML hardware for every consumer. >LLms running on standalone affordable boxes could become a ubiquitous home accessory They could be, but why is it Nvidia's fault if they don't happen? They're in the business of making money, not fulfilling dreams, and currently they can barely fulfill their orders for the datacenter customers. Consumers could move the LLM stuff on cheaper Apple HW or Intel or AMD SoCs if they can't outbid the datacenter companies for Nvidia silicone. Seems like a market opening for Nvidia's competitors to price cut them. If they don't exploit it and let Nvidia dominate, it's their fault. It's not Nvidia's fault their competitors were asleep at the wheel since they launched CUDA in 2007 and were helping researchers put their GPUs to use for parallel computing for over 15 years.

gremlinsinc 3y ago
If AMD were smart(er), their cpu's are awesome at least... They would team up with intel, google, apple, etc to create a machine learning open cuda alternative, such that all GPU's could essentially be used by ML software equally, I think Nvidia's real hold on AI is that most AI libs use CUDA, and nobody else can really compete when all the tools use X, it's like if firefox launched with their own different HTML syntax because HTML was proprietary, and every other browser did the same thing. Something like chrome : chromium dynamic would work wonders for bringing a sort of standard, not to mention more minds could create better and better implementations.
- ornitorrincos 3y ago
  They did try, apple made OpenCL and released it to khronos to make a standard, but never got wide support(well, they got plenty of manufacturers on board, not so much users). By that time nvidia already had an advantage with CUDA and their opencl support always lagged.
- deleted 3y ago
  [deleted]

WheatMillington 3y ago

NVIDIA are not stupid, they understand their marginal revenue and marginal cost analysis, and they obviously decided they're making the most money doing what they're doing. It's asinine to believe we, with access to almost none of the requisite data, could tell NVIDIA how to turn a better profit.

ActorNightly 3y ago
>decided they're making the most money doing what they're doing Yes, exactly like all the big tech companies with vast departments for market research that hired a shitload of people, then when economy turned, they started doing layoffs. A.k.a short term profit seeking.