11 ms·
Nvidia Reveals RTX 6000 with 48GB GDDR6 ECC Memory
- kickofline 4y agoHow much of an improvement over the previous generation would this be for SD?
- DannyBee 4y agoI'm not sure who this is really for. I mean that honestly. At least on the workstation side - i do a lot of solidworks-based 3d modeling. The A6000 can easily, for example, raytrace in real time anything i can even find to throw at it. Like models that Solidworks still has trouble opening and rendering normally can raytrace instantly. What part of workstation software is still GPU bound at this point on high end GPU's? I guess if CAM was taking more advantage of GPU's, i could see it useful there, but on the modeling side, i honestly don't get it.
- paco3346 4y agoAlthough an small audience, this is exactly the kind of card that live video processing (IMAG) needs. Software such as Hippotizer, Pandora's Box, Resolume, and vMix rely heavily on GPU.
- whalesalad 4y agosoftware grows with the hardware, in a few years your A6000 will be barely good enough to play Battlestation 2096
- boriskourt 4y agoAccess to more memory opens up higher resolutions in ML video and image workflows. I am pushing close to these numbers for GPU memory on the 64G M1 Max.
- andy_ppp 4y agoWhat are you using to build your models out of interest? I've no idea what is optimised for machine learning on M1 chips yet?
- DannyBee 4y agoAll of the responses are about game development, and that sort of thing which I totally understand. but all of their quotes are from like cad developers. so I definitely feel like they are mistargeting at this point
- Stevvo 4y agoWith 16GB I can easily run out of VRAM and encounter serious slow downs when working with multiple 4K texture sets in Substance Painter. That's working on Hero assets for current-tech games. UE5 Nanite assets and film assets are much heavier.
- DannyBee 4y agoI totally buy the game developer need here, as well as some of the live video processing folks. but that convinces me even more that these are totally mistargeted given their sales points
- fsh 4y agoPhotorealistic renders for catalogs and architectural visualization can still take many hours on the best GPUs available (if the scene even fits into VRAM). Even a slight performance improvement can be worth a lot of money for companies doing this kind of work.
- fbanon 4y agoThat's not really ray-tracing. That's just regular GPU rendering with physically-based materials and some ray-tracing effects for extra chrome.
- dylan604 4y agoColor correction uses as much GPU memory as it can get. I used to maintain DaVinci Resolve systems with expansion PCIe chassis to handle all of the exapnsion cards. Each year, we'd upgrade the GPUs with more cores and memory. Each upgrade allowed the system to be much faster. However, this used to be on Macs, so an Nvidia card is no longer useful on that platform. Might still be a cool thing to play with under WinX/Linux
- zarzavat 4y agoAs someone who is totally ignorant about film color grading, why does it require so much VRAM? I’ve done color correction in games and it’s computationally very cheap to throw a LUT in there, so clearly something else is going on?
- dylan604 4y agoFirst off, throwing a LUT in there is not color grading!!!!!!!! People making this claim are appreciated as it lets me know immediately that they are not familiar with the subject at all. It's like a shibboleth. Edit: I mean this in the nicest way. It's just a pet peeve of mine. You already stipulated you didn't fully grok the topic. In a full color grading session, you can have power windows. You can have those power windows tracking. You can have noise reduction. You can have other filters. You can do so so much. All of that takes up memory. You can be dealing with 8k footage. You can have many many many layers of that footage. You can be grading in >16bit color space. You can do all of that with very little VRAM at a snails pace, or you can do it in real-time with all of that VRAM and keep the client in a supervised session happy. With all of that VRAM, you can export at faster than real-time for delivering the content to the client at the end of the session rather than the next day after an overnight render.
- moyix 4y agoThe A6000s have become very popular for ML engineering, especially in the NLP space since those models are enormous. 48GB VRAM and 2x faster training time is tempting for those applications!
- binarymax 4y agoI feel like this is the card for the desktop deep learning scientist. The A100 is much more expensive, and are better for the datacenter and don't really suit a home rig. The recent 4090's looked nice but don't support NVLink. For me, it's all about the RAM. 48GB is a dream.
- moyix 4y agoYep, it's targeted at the same kind of people who bought the A6000s (me).
- bitL 4y agoMe as well, but with 48GB of RAM what is the point? They should sell at least 96GB one. There is no pressure/enticement to upgrade from A6000 to be honest.
- moyix 4y agoAgreed (especially since I just got a third A6000 this week), but by the time they come out the faster training/inference time might be enticing to some. I would love to see an 80GB workstation card though...
- bick_nyers 4y agoThat all depends. For the price of the RTX 6000, you could purchase FOUR 4090.
- runnerup 4y agoYeah obviously better to go with 4090's if your model fits in the VRAM. But if the models you want to work with are larger than 24GB you'll need to spend the big money.
- monkmartinez 4y agoOr purchase ampere cards with NVLink and pool the memory.
- machinekob 4y agoNvidia smells a lot of profit and maximise it by forcing prosumers to buy trashy value "quadro" or even worse buying data center GPU's for working on state of the art problems (6-20k usd minimum investment to do normal sized Deep Learning in next 2/3 years incoming and probably 3/4x that for training). Big fuck you for nvidia with this release prosumer market is dying right now and there is no alternative cause AMD software is so bad you are forced to use CUDA in for example DL/DS.
- mort96 4y agoI don't understand why the ML community went so hard in on CUDA. Maybe using nvidia cards made sense back around pascal, but I don't get why they would choose to lock themselves into nvidia's proprietary APIs. You reap what you sow.
- binarymax 4y agoBecause CUDA was a fantastic API from the beginning, and it took forever for OpenCL to catch up (has it even really caught up?). I remember writing CUDA parallelized C++ code in 2010 and it was a piece of cake.
- mort96 4y agoAlright, in that case I suppose the trade-off was clear: use a nice API and lock yourself in, or use a less nice API and be able to use any hardware. Nvidia cards becoming less competitive over time is in any case a very predictable outcome. Sounds like the ML community made a trade-off, and this is the downside of that trade-off.
- meragrin_ 4y ago> Sounds like the ML community made a trade-off Nope, AMD never gave them a choice.
- binarymax 4y ago@mort96 I've reached the thread depth and can't reply directly - but it's not just a case of a nice API. I don't even think it was possible to use alternative hardware and SDKs for consumer GPGPUs for deep learning when the field was taking off. It was not so much a choice but the only viable option. Has Nvidia taken advantage of their position? Absolutely. But don't fault the ML community when there was nothing else available.
- Certified 4y agoCould they have picked a more confusing name? They already had a Turing based Nvidia RTX 6000 from 2018 [1]. Then the RTX A6000 came out based on Ampere. Now this new one has to be called the the "NVIDIA RTX 6000 Ada Generation". This is going to be such a headache for anyone who has to requisition things through a purchasing department at work: "No I don't want the RTX 6000 or the RTX A6000. I want the RTX 6000 Ada." [1]https://www.nvidia.com/content/dam/en-zz/Solutions/design-visualization/quadro-product-literature/quadro-rtx-6000-us-nvidia-704093-r4-web.pdf https://www.nvidia.com/content/dam/en-zz/Solutions/design-vi...
- NohatCoder 4y agoWill also be a great name down the road if they eventually release an RTX 6000 series.
- jl6 4y agoDisorientation marketing is a technique to prevent customers from developing their own mental model of how a product should be contextualised (better or worse than competitor/predecessor?). In place of such a model, the vendor substitutes their own messaging.
- manimino 4y agoIt also makes comparisons to rival products (AMD in this case) more confusing.
- cptskippy 4y ago> Disorientation marketing Is that really a thing? That strikes me as the same level of shady practices as things like Planned Obsolescence.
- namlem 4y agoBased on the response of PC gamers on reddit to the 40 series cards, that's probably a good thing. People with 1440p@60Hz monitors complaining about cards meant to run 4k@144Hz being too expensive.
- 4y ago
- jitl 4y agoWell, I want a 2-slot RTX 40 series Titan that would be useful for both gaming and light ML, but this thingy at $6000 is really not it.
- binarymax 4y agoRTX 40 series doesn't support NVLink, so sadly it's not an option. Pretty sure this was a strategic exclusion by Nvidia to make sure you couldnt get cheaper cards and link them together for parallel compute, and instead push these more expensive prosumer cards.
- bick_nyers 4y agoYup. They started this transition away from NVLINK in the same generation in which they introduced their tensor cores. It's part of their ML profit strategy. There's really nothing you can do outside of soldering on higher capacity RAM chips onto a 4090. There are some 20GB 3080 cards floating around out there.
- squeaky-clean 4y agoMaybe they just want one slimmer card for an itx build? All the 40xx announcements from nvidia were 3-slot cards.
- jitl 4y agoYeah I can’t replace the 1080 Ti I have with any of the 40xx cards in my DAN A4.1 case. They’re all quoted as a little bit too big. And with EVGA out, who is gonna make a quiet card for me?
- LegitShady 4y agomost of the 4080/90 cards shown so far are 3 slots at least. I think there was one 2.5 slot card.
- bick_nyers 4y ago$6k and still no Display port 2.0? NVIDIA is really holding that back for when 8k is ready for mainstream huh? I guess even for $6k on a graphics card you still can't effectively future proof anymore.
- nottorp 4y agoWhat's the power consumption, 2 kW?
- banana_giraffe 4y agoLess than the 4090 at 300 W Which confuses me, is this one of the 4080 chips with a lot of memory?
- adrian_b 4y agoNo, on the contrary, it is the fully enabled chip used in 4090, with all the 18k shaders a.k.a. CUDA cores available. In RTX 4090, 2k of the 18k are disabled, so only 16k are available. In RTX 6000, presumably both the clock frequency and the supply voltage are lower, for better reliability, and that lowers the power consumption from 450 W to 300 W.
- dotnet00 4y agoIt's probably the same as a 4090 chip, but a higher quality bin such that it's more efficient than the ones binned for 4090s.
- nottorp 4y agoOuch. So extrapolating, they could do a 75W no extra power 4050 hypothetically. If they cared to bin their parts. But instead it will be 130 W.
- hardwaresofton 4y agoSomehow we’ve gotten to a world where the graphics cards has ECC RAM and the main system doesn’t
- dymk 4y agoDepending on the chipset (in particular, AMD mobos), it's not too hard to find ECC compatible motherboards for "home" use.
- bedast 4y agoThis is probably not targeted at gamers. I'd bet the RTX 4090 will have far superior gaming performance at a lower price, while this will likely have superior CUDA/tensor performance. I can't see how ECC RAM would be beneficial to gaming, but for drafting, scientific applications, machine learning, etc, it'd be pretty valuable. So the chances are pretty high this would go into a machine with ECC RAM for the system as well.
- Tepix 4y agoIt seems inevitable now that NVIDIA and the USB Consortium will work together on naming future technology. They have proven to be the best at this discipline with no competitor in sight. Consumers of the world are in awe.
- Narishma 4y agoI don't know, Microsoft is pretty good at this. Their Windows and Xbox divisions especially.
- Tsiklon 4y agoIs this the third naming convention in 3 generation or is it a return to the previous naming convention? Because it looks like this is intended to be deliberately confusing. So we had in the last 3 generations; Quadro RTX 6000, RTX A6000 and now RTX 6000. Catch a grip nvidia - this is a joke.
- Tsiklon 4y agoI wonder if this is a lower powered dual slot card, simply because the buyers of workstation models from HP, Dell etc would be unreasonably hamstrung by a three slot model - traditionally these systems have a full powered x16 lane in the location that would be taken by a three slot cooler.
- bedast 4y agoIs Nvidia getting in on the same joke USB and HDMI are? Serious question. They have a RTX 4090, RTX 4080, and RTX 4080 but less good. And now RTX 6000? What happens in 2 generations when they want to make a RTX 6090 and so on? Why are there 2 very different RTX 4080? I mean, really, this started at the 3000 series. I have a laptop with a dock that contains a RTX 3080, full stop. But you have to dig into the specs to learn it's not a full RTX 3080. But it's also not a RTX 3080 Max Q? It's a "RTX 3080 Laptop" whatever that's supposed to mean. But that's not in the marketing. It's fully implying that it's a full RTX 3080. This is how users get confused and angry when their hardware isn't working as expected.
- bitL 4y agoOnly 48GB of RAM, no NVLink - sounds like a partial downgrade from A6000. Not very enticing to be honest.
- yrgulation 4y agoOf graphics cards keep improving at this rate and the price keeps dropping then vr will become actual reality.