4 ms·
it is 20-30% slower than 4090 or H100 in compute, the only improvement is slightly more RAM. This card is not for ML (on purpose) - it is for more enterprisish
by ex3ndr 3y ago
it is 20-30% slower than 4090 or H100 in compute, the only improvement is slightly more RAM. This card is not for ML (on purpose) - it is for more enterprisish tasks: some advanced video streaming/rendering, virtualization, etc.
- michaelt 3y agoIt's for some ML tasks. Just not large language models. If you're making, say, an ML-based on-premise CCTV system and you need to run several large ResNets at the same time? And you don't want to go rack-mounted, as some sites don't have a data centre? And you want the longer lifecycle and guaranteed spare parts availability of an enterprise product line? This could be the card for you. Admittedly it's a rip-off, but the Workstation/Quadro line always has been. Honestly I'm not sure how healthy the workstation market is right now - with the rise of work-from-home and hybrid working, I don't see many people using huge desktops any more. And when Adobe puts a powerful generative AI feature into Photoshop, they don't expect users to upgrade to powerful GPUs - they run it in the cloud, so it works for users with puny GPUs and Adobe can get that sweet sweet recurring revenue.
- ex3ndr 3y agoNo, this cards would be inferior to 4090, that you can get everywhere and you can buy 3 of them for "spare parts"
- YetAnotherNick 3y agoComparison with 4090 is irrelevant as 4090 legally cannot legally be used for commercial usecase, and most companies just follow the law.
- lreeves 3y agoSorry what does that mean? There are many people creating content and software for commercial use cases with these cards and I've never seen a EULA anywhere preventing this.
- michaelt 3y agoYetAnotherNick is probably referring to the geforce eula [1] which says: "Customer may not [...] provide commercial hosting services with the SOFTWARE. [...] The SOFTWARE is not licensed for datacenter deployment, except that blockchain processing in a datacenter is permitted." So if you were e.g. an ad agency artist using a 4090 at your desk to generate images for commercial use - that's fine, because it's not in a datacenter, and the commercial services you're providing with it aren't hosting. I've never heard of nvidia taking any enforcement action, or defining precisely when an office becomes a datacenter - I suspect this is mostly to ensure the big cloud providers don't offer 4090s. [1] https://www.nvidia.com/en-in/drivers/geforce-license/ https://www.nvidia.com/en-in/drivers/geforce-license/
- lreeves 3y agoYeah I'm aware of that but that's pretty distinct from "cannot legally be used for commercial usecase".
- YetAnotherNick 3y agoI can't edit my comment now, but by commercial I meant "using 4090 for commercial purpose" that is renting, not not being allowed to create commercial content using the card. Reading my comment again, obviously it wrong and I should have been more careful with the wording.
- paulmd 3y agoThis limitation doesn’t really apply anymore with the open kernel driver. They can’t stop you from using a GPL-licensed driver in a datacenter or any other way you want.
- edgyquant 3y agoWhy/how is this even legal?
- ex3ndr 3y agoWait, they explicitly allowed to use cards for blockchain and prohibited for anything else?
- papichulo2023 3y agoLot of companies offering 4090 leases, heavily doubt that only cloud gamers ans AI hobbyist rent them.
- selfhoster11 3y agoIf you have any sources for that claim, you should post them here. As it stands, it's a pretty unusual statement.
- gambiting 3y agoLol, what? Of course it can. Nvidia can say they don't allow it in their user agreement, but last time I checked user agreements don't form actual legal law. Nvidia can sue you for breaking the agreement(I wonder what for, exactly?) But that's about it. The worst thing that can happen is Nvidia declining any warranty repairs on these cards as they've been used outside of the intended use. But it's definitely not a legal issue. And EULAs in general are just not enforceable outside of the US.
- borissk 3y agoIMHO it's the against the EULA to rent a 4090 - and this is why the big cloud platforms don't offer any. But using a 4090 in a company's own datacenter should be fine.
- muttled 3y agoRunPod is fairly large and openly advertises the consumer cards. I wonder if they have an agreement?