4 ms·
HP ZGX Fury Is Now Orderable: GB300 Superchip, 748GB Unified Memory
- TechDebtDevin 1mo ago[dead]
- Retr0id 1mo agoHow many arms and legs does one of these cost?
- shmoil 1mo ago3.14 kidneys.
- theplumber 1mo ago>> 252GB of HBM3e at 7.1TB/s, So it has only 252GB of actual ”AI” memory making it “useless”/toy for actual real world AI workloads(I.e it can’t replace something like opus 5)
- kees99 1mo agoShould work just fine for MoE models where active set fits into 252GB.
- theplumber 1mo agoCan’t you do that already more or less with a Mac Studio with 256 or better 512fb of ram?
- fc417fc802 1mo agoWhere are you getting 7 TB/s of memory bandwidth?
- theplumber 1mo agoFair point but you get that only for 252GB of ram so it’s not even “totally better” than a Mac Studio ultra with 512GB RAM. It still the old “smaller but faster than a Mac” stuff nvidia sells.Maybe in 1-2 years they will match the Mac 512 but then Apple will release an even bigger Mac
- fc417fc802 1mo agoI don't know about "useless" (it seems quite useful to me) but I do feel mislead. It's unified memory in the same way that my current dGPU has unified memory. I guess nvlink-c2c probably (?) doesn't introduce a bottleneck but it's still two distinct arenas with very different performance characteristics.
- theplumber 1mo agoI find it just misleading by advertising 700GB RAM as AI headline. I could plug a 32GB GPU to my 1.5TB ram server and call it “AI station with 1.5TB+ RAM” just so that you find it actually useless compared to the headline
- cmrdporcupine 1mo ago7.1TB/s of HBM is not "useless" -- that's 30 times the memory bandwidth of my DGX Spark -- and nobody is expecting such a machine to run "Opus 5" on its own. For such large models even datacentre GB300 NVL72 are multiple trays linked together via NVlink etc. This machine has QSFP ports and ConnectX for linking up for larger models. It's a workstation, not a rack. It's for AI researchers. I'd love to have one on (err, under) my desk. What even is this comment?
- theplumber 1mo agoMy point is this is “useless” because you can’t run large models. It’s like having a very fast and expensive SSD with a very small capacity. It’s not useless but it is for “real work”. Apple has been providing 512GB ram machines for several years so to say you need a rack to run a large model for personal usage it’s missing the point. You needed a rack of nvidia cards to match an 128GB ram Mac as well a while ago so it’s more of the same.
- cmrdporcupine 1mo agoPeople who buy Macs to run local inference are not the target audience for this machine. It's an AI research workstation for people whose ultimate work goes on production GB300 NVL72 data centre racks (and for large models you link them together.) It's also about 15x the memory bandwidth of a Mac. For models that fit you'd be looking at hundreds of tokens per second on decode and prefill many times that. And has CUDA, which is (likely) what your production system will use. And runs a real server operating system. Also by the time you spec'd out a Mac with the same total memory capacity and computation you'd also be as expensive. And still not have as many cores, nor have the ConnectX RDMA networking speeds.
- LargoLasskhyfv 1mo ago[dead]
- varispeed 1mo agoFurious What is it with those stupid names? No price, so of course this is not for the smelly working class.
- Egg-Man 1mo agoImagine a beowolf cluster of these!
- self_awareness 1mo agoI guess I'm too poor to even know the price
- wolttam 1mo agoMSI’s DGX Station (what this is) was listed for $99K
- chedabob 1mo agoDell's equivalent starts at £180k.
- NKosmatos 1mo agoThese are for billionaires/multi millionaires/cryptobros/stupidly rich people who can afford such “toys”. I’d really love to see a geek/tech freak/gadget lover/IT/homelab billionaire buying large number of things we mere mortals can’t afford, but only dream of, and then he blogs about them ;-)
- Gigachad 1mo agoI’m gonna bet in 5 years the price will be in range for the average tech bro to get their hands on one. It just doesn’t make sense to buy this stuff at peak prices.
- fortran77 1mo agoSince I'm a "retro computing" guy, I look forward to buying one of these on eBay or at a Vintage Computing Fair for a few hundred bucks 5 years from now.
- dsrtslnd23 1mo ago252GB of HBM3e at 100k vs. a multi A6000 96GB setup. GB300 seem expensive in comparison at ~$100k. Am I missing something?
- _diyar 1mo agoWithout looking it up and doing the math, I bet GB300 has higher Tflops and memory bandwidth, especially when used with e.g. NVFP4.
- hgoel 1mo agoPlus lower peak power draw
- rbanffy 1mo agoHow long until the higher power draw nullifies the higher acquisition price of the GB300 machine?
- cyanydeez 1mo agoAre you in a world where energy prices are goimg down?
- rbanffy 1mo agoQuite possibly, depending on grid-scale renewable deployment. I also am about to install a set of solar panels, so a base level of power will cost me only the depreciation of the PV hardware. We could condition datacenter installs to providing power to the grid - you want to build a datacenter, you also need to build a wind or solar farm that can fully power its peak load.
- cyanydeez 1mo agoAmerica has decided the answer is no.
- dyzone 1mo agoBut can it run crysis?
- jareklupinski 1mo agoif not yet then it may be achievable: https://www.guru3d.com/story/nvidia-dgx-spark-achieves-175-fps-in-cyberpunk-2077-guide-enables-dlss-4-and-path-tracing/ https://www.guru3d.com/story/nvidia-dgx-spark-achieves-175-f...
- einpoklum 1mo agoCan I get 32 GB of RAM for a sane price instead?
- m4rtink 1mo agoYeah, all these overpriced toys will be obsolete soon anyway, but regular memory for PC for actually doing some productive stuff is still overpriced. Pure madness.
- fc417fc802 1mo ago> a Kensington slot I think you might need a bit more than that at this price point ...
- alexfoo 1mo agoAt the expected price point it would be nice if it came with a free pied-à-terre in Kensington (https://en.wikipedia.org/wiki/Kensington https://en.wikipedia.org/wiki/Kensington). Just a small studio apartment, nothing special.
- noir_lord 1mo agoYou'd need to spent ~£500K+ to get a studio in Kensington these days that isn't a shoebox. One listing is 410K for 280 sq/ft coming out at £1464 per square foot, almost exactly 10x the price per sq/ft we paid for our house a few years ago. So $100K would be £74K which would get you ~50 sq/ft.
- yread 1mo agoA square (or cubic?) foot would be enough to house it
- Retr0id 1mo agoA kensington lock in this context is like a sign that says "do not move", which is still kinda useful
- fortran77 1mo agoI have a $50,000 Tektronix 'scope on my bench that's Secured with a kensington lock. I am in a small office in a building I own and I rent out some extra space to another 3 person engineering company. One weekend they tried to remove my 'scope from the bench because they had something "important" to work on. They quickly discovered the lock. (The whole thing was caught on camera.) They weren't trying to steal it, they just wanted to bring it over to their side. But the lock did its job! This is the perfect situation for a Kensington lock. I yelled at them the next day telling them if they need a Series 5 'scope they could go rent or buy one.
- deleted 1mo ago[deleted]
- pritambarhate 1mo agoLooks like multiple vendors are seeling these: https://www.gigabyte.com/in/Enterprise/Tower-Server/W775-V10-L01 https://www.gigabyte.com/in/Enterprise/Tower-Server/W775-V10... https://www.msi.com/Landing/NVIDIA-DGX-STATION https://www.msi.com/Landing/NVIDIA-DGX-STATION
- surcap526 1mo ago[dead]
- theplumber 1mo agoSomeone should edit the title to make it clear it only has 252GB of “AI” memory
- edg5000 1mo agoAgree, the CPU memory is about 400GB/s vs. Apple M5 Ultra at 1.2TB/s. But the M5 only has that, not the 7TB/s portion. So this box could* still be faster when using the full 748GB if both RAM types can be used without the slower part bogging everything down. *That comes down to implementation. Maybe somebody can chime in on this.
- cagenut 1mo agoI'm just barely starting to wrap my head around mapping model sizes and quants to hardware components and constraints. I don't get what this device is for. I a million percent understand wanting 252GB-VRAM, that would get me a 280-320B model like glm-5.3 or deepseek-v4-flash, which would be a massive improvement over my gpt-oss:20b 16GB toy. I would gladly pay a grand for this, I would never pay ten grand for this, and it seems to be priced around a hundred grand. So obviously the customer is commercial not consumer. Can anyone planning a project around one of these at work share what their workload is shaped like and how they're modeling price/performance? For instance, I don't get the 512GB of system memory, I'd gladly drop that to 128 to save money. Am I missing something about commercial workloads? Is a 1T parameter model at 20 tok/s more important to your workload than a 300B one at 60? Is it simply a co-dependency of not the model but the other software you're running on the machine thats using/interacting-with/being-driven-by the model? Whats your napkin math to justify 100k? Actually thats not even really the question, its more like - whats your napkin math to determine between the "dual linked GB10" use case vs this product's use case vs an 8U supermicro with 4 cards use case.
- kstrauser 1mo agoCan you imagine a Beowulf cluster of these?
- bentt 1mo agoIt's actually kind of nostalgic to see off the shelf computers have such a sky high price again. Back in the Silicon Graphics days the prices were aspirational! Give me something to lust over again... makes me feel young.
- karmakaze 1mo agoThis is a bundle where you end up paying for parts that aren't as useful: - 252 GB HBM3e VRAM - 496 GB LPDDR5X RAM I would rather have a system using 2x Instinct MI350P GPUs (288GB total) for much less.