9 ms·
HP Updates Z8 Workstations: Up to 56 Cores, 3 TB RAM, 9 PCIe Slots, 1700W
- userbinator 9y agoIt will be quieter than a rackmount server since there's more room for bigger, slower-turning fans that move the same rate of air, but at full load is still likely to be quite loud.
- uoaei 9y agoPut it in the other room! We have long enough cables for the peripherals.
- PascLeRasc 9y agoI hope you don't need USB 3 for anything then.
- icelancer 9y agoPowered extensions work just fine, I use 10m active cables with no issue.
- katastic 9y agoSo we're banking on a computer running with wires across into another room. ... or holes cut in the wall. Instead of just buying a quieter computer (or upgrading it)?
- uoaei 9y agoSeems like a simple, cheap solution compared to shopping around for a quieter computer or parts. How is it so problematic to have cables running along the molding and around a corner? In fact, why bother worrying about the noise anyway? Some people function much better with white noise in the background.
- mugsie 9y agoI had one of the (now 2 gens) old Z6xx series workstations issued by work, and I ended up buying a second hand one from eBay to replace it when I moved jobs. It was dead silent. I could hammer all the cores, RAM and disks, and not hear anything from it. At one point I had 4 of them under my desk, and there was more noise from the MacBook Pro.
- rl3 9y ago>AMD Radeon Pro WX 9100 Graphics (16 GB HBM2) Surprised the Radeon Pro SSG isn't an option. It's basically the WX 9100 with 2TB of flash memory slapped on that you can use as VRAM: https://pro.radeon.com/en/product/pro-series/radeon-pro-ssg/ https://pro.radeon.com/en/product/pro-series/radeon-pro-ssg/
- DiabloD3 9y agoNot quite. It requires special application support, you are 100% unlikely to ever discover an app in the wild that can use it.
- whyenot 9y agoAccording to the SSG website, Autodesk Maya will fully support the SSG, including the 2TB memory. "ProRender plug-in for Maya has full support for the out-of-core rendering feature found on the Radeon™ Pro SSG which allows the application to tap into the full 2TB of memory found locally on the card. This allows users with very large models to render fully accelerated by the GPU. "
- rl3 9y agoApparently application support is implemented via the SSG API. It doesn't look like it's a public API; I can't find any documentation anywhere.
- kuwze 9y agoDo you know anything new about the Radeon Pro SSG? I haven't read anything since the announcement.
- neilmovva 9y agoThe fact that "2TB is addressable" is irrelevant. Putting NAND on the board doesn't improve latency/bandwidth nearly enough to function like vram. Nvidia has also supported unified virtual memory since Pascal, meaning you can address your cpu's ram in GPU code. The "SSG" card still has the 2tb of flash on a PCIe interface, so not much difference from existing systems beyond marketing. I'd expect very few real world perf wins.
- 0xbear 9y agoThese days if you need proper compute, you need to focus on the GPU. NVIDIA 10 series GPUs are 10x the throughput of high end intel CPUs, and less than 1/10th the cost. It’s not even funny anymore. It’s a shame you can’t even have 4 GPUs in such an expensive and bulky workstation. Back to the drawing board, HP.
- pmorici 9y agoSounds like you want something like the Nvidia DGX workstation... https://www.nvidia.com/en-us/data-center/dgx-station/ https://www.nvidia.com/en-us/data-center/dgx-station/
- deleted 9y ago[deleted]
- mugsie 9y agoVery few applications can make use of such a large amount of GPU cores - and all of them would need much more CPU cores than this provides to coordinate the work. Any applications that can would be either run on clusters of servers to really parallelise the work, or is so custom you may as well buy a threadripper and a custom case. Hell most apps can barely take advantage of multi core CPU.
- 0xbear 9y agoYou got that last sentence right: I’m not aware of any apps which can take advantage of even half this many cores. Intel is deficient in terms of memory bandwidth, so most things begin to flatten out at 8 physical cores or so, and take a nosedive when you attempt to use all of them. While you are right that there are very few apps able to take advantage of quad GPUs, for anyone who does serious number crunching it’s not a problem at all to use all of them using popular deep learning frameworks. They aren’t just for deep learning, you can do a lot more with them. And e.g. PyTorch will automatically parallelize certain things across multiple GPUs for you, with near linear speed up.
- 9y ago
- elorant 9y agoJust for the RAM you'll need $20k. So I guess the whole rig would cost at least $30k. That is of course if you max out all the equipment.
- the_real_sparky 9y agoHP prices are... high. It's easy to spend $10k in processors alone for a dual-Xeon system. The ones mentioned in the article will be over $13k each: https://ark.intel.com/products/120498/Intel-Xeon-Platinum-8180M-Processor-38_5M-Cache-2_50-GHz https://ark.intel.com/products/120498/Intel-Xeon-Platinum-81...
- yeukhon 9y agoIf you are talking about srlf-build, there is reason to avoid that for people who can afford. It is called warranty. Hardware rig like this goes through testing and the support package usually is pretty good. I don't have first-hand experience, but I know Oracle would send engineers onsite to troubleshoot if required. Unless you are ready to tackle the build, the testing, and the support of the hardware rig, you want to avoid. You don't have to be Dropbox or Netflix (I don't believe they build custom servers like facebook and Google does, perhaps they buy from other vendors or from opencompute project).
- PaulRobinson 9y agoI believe both Dropbox and Netflix are very, very cloud (specifically AWS), heavy.
- yeukhon 9y agoThey are, but they have their own boxes for critical infrastructure. Dropbox, however, moved a lot off of AWS.
- danieldk 9y agoIndeed, we recently asked invoices for a new machine for deep learning with 768GB memory, modern Xeon CPUs and the latest generation nVidia Tesla. The HP offer costed nearly twice as much as Dell's.
- the_real_sparky 9y agoI've got an HP Z640 workstation with dual E5-2690 v4's and it is basically silent under full load. It has no problem running all 28 cores at 3.2GHz which is the max all-core speed for that processor.
- phren0logy 9y agoThat's really impressive. How many DIMMS and spinning HDDs is it cooling?
- the_real_sparky 9y agoOnly 8x8GB since I'm working on CPU limited simulation tasks. One of the CPUs and 4 of the DIMMs is on a daughter board in the Z640, which makes the whole thing even more impressive. It's a fairly compact machine. Storage is just a single SSD and single HDD. Graphics is a low end Quadro just to get the 4x mini-DisplayPort. The HP Z8xx series would probably be a better choice if a person is going to go crazy on the rest of the hardware. But that's just conjecture on my part based on the fact that my current processors are running near TDP (but aren't being throttled down based on the monitoring I have done.)
- madengr 9y agoWhat'ya simulating?
- oso2k 9y agoI use my z820 and z620 for running OpenShift/Kubernetes/Containers/VM workloads.
- the_real_sparky 9y agoElectric grid dynamic/transient event (disturbance) simulations. It's essentially modeling the response of electromechanical equipment (generators and large loads), large solid state devices (utility scale renewables and fast-switching reactive devices), lumped load models, and protective devices to events on the electric system. The simulations run in ~1ms timesteps over 10-30 seconds of real world time (which can take 4-20 minutes of CPU time). Each event is independent and they parallelize pretty much linearly. Python multiprocessing is the lifeblood of this work. Edit: I guess I should be clear and say that the simulations themselves are running on a commercial software package (Fortran based) and I'm simply setting them up, spinning them off, and then processing all of the resulting data in Python.
- scott_karana 9y agoIf I wanted to build something like this myself, are the motherboards fairly commodity? Or do you get into bizarre non-ATX custom form factors with bespoke cases and PSUs to match? I've built plenty of gaming rigs, but have never been interested in this world until recently... and would appreciate any insight :)
- chriscappuccio 9y agoFor something at this level of sophistication, you'd typically use an integrated case/cooling/motherboard combination from a company like SuperMicro. You could always buy a board and mate it up with another case, it will likely be a SuperMicro board...
- oso2k 9y agoThere's posts here on HN and I think techspot that discuss this [0][1]. [0] http://www.techspot.com/review/1155-affordable-dual-xeon-pc/ http://www.techspot.com/review/1155-affordable-dual-xeon-pc/ [1] http://www.techspot.com/review/1218-affordable-40-thread-xeon-monster-pc/ http://www.techspot.com/review/1218-affordable-40-thread-xeo...
- akhilcacharya 9y agoWhat exactly are these machines used for?
- oso2k 9y agoCAD, 3D workloads, 4K/8K video editing, stuff like that. They're great for running dozens of VMs especially if you're running with SSDs and a non-integrated RAID card. The integrated RAID chip on the z820/z620 is horrible.
- oso2k 9y agoI use my z820 and z620 for OpenShift, VMs & running my 6 monitors.
- akhilcacharya 9y agoI thought people used OSX/Win for video editing?
- mugsie 9y agoI used to use them as hardware for a test and development OpenStack cloud. On a decent spec'd Z620 I could simulate a full OpenStack cloud, and even boot quite a few VMs inside it for end to end testing.
- gnufied 9y agoDo you generally run openstack on host OS itself or within VM? Or to clarify - I have noticed some problems when Openstack runs inside virtualized environment, but if it directly runs on host OS itself, it seems to be fine.
- oso2k 9y agoWith OpenStack it is generally recommended to run it on bare metal boxes. Likely, the issues you're running into are network based (or running an SDN over an SDN).
- 9y ago
- desireco42 9y agoI don't need it, but I would love if I could afford one and use it daily. And those who comment who use them, just so you know I am jealous of you :).
- dingo_bat 9y agoSame here. I'd use mine to just do regular stuff my laptop handles right now. But I'd know I'm browsing facebook on a freaking supercomputer. And that'd make me happy :P
- KGIII 9y agoI've purchased whole racks full of servers that didn't have as much compute power and cost a heck of a lot more than this. I use a nice mobile Titan but it is nothing compared to this. What crazy times we live in. I can't justify buying one of these. I keep tying to come up with a good reason. I suppose YouTube would finally run smoothly.
- desireco42 9y agoCan someone explain me why memory is costing so much? And would it make sense to buy memory separately? I am kind of playing /w configurations to see what I can get.
- oso2k 9y agoAfter 16GB, the cost-density curve ($/GB) inverts because the density is super valuable for enterprise and other large customers, especially for ECC.
- yuhong 9y agoThe TSV technology that the 128GB DDR4 LR-DIMMs uses is still very new (Samsung is the main vendor at this point). It is only recently that the price of 64GB LR-DIMMs are getting close to the price of 32GB RDIMMs. As a side note, you also need special Xeon models to get the full 1.5TB per socket with the 128GB DIMMs now.
- desireco42 9y agoI see. So essentially it would make sense to get one with smaller memory and buy more when price goes down. Thank you for explaining.
- deleted 9y ago[deleted]
- bitmadness 9y agoAnyone here have experience regarding Dell or Lenovo workstations? Which should I get?
- myrandomcomment 9y agoBut how many FPS with Minecraft? Can I play Civ6 on a huge world without waiting forever... Tounge firmly pressed in cheek..
- katastic 9y agoI know you're not serious but Minecraft is single-threaded. So ... run 56 games at once?
- myrandomcomment 9y ago1.8 implemented multithreading.
- lucaspiller 9y agoIf the prices of one of these new are a bit out of your budget, but you still want a relatively powerful workstation, take a look at used machines from a few of generations ago. Last year I picked up a Dell T3600 with a Xeon E5-2670 (V1 - 8C/16T) and 32GB ECC RAM for €400 delivered. It's not completely silent (maybe HP are better in that regard based on comments here?), but it doesn't make much noise - at least compared to what you'd expect from the power it gives. I now work from home, and having previously primarily used laptops, this thing feels like a beast.
- dis-sys 9y ago> a Xeon E5-2670 (V1 - 8C/16T) and 32GB ECC RAM for €400 delivered. that stuff was $150-200 delivered if you buy from taobao.com. people also need to realize that dual e5-2670v1 has a cinebench score of 2,000, that is just slightly highly than a single ryzen 1800x.
- zokier 9y agoAnd last I checked there isn't a single Ryzen based workstation on the market, something I wouldn't expect to change anytime soon.
- deleted 9y ago[deleted]
- lucaspiller 9y agoYes if you want something that needs the fastest CPU you probably don't want this machine, but in that case you are probably willing to spend a lot more. The laptop I upgraded from had a score of 250, so for me it's a big difference. I checked prices for sourcing my own hardware on the same platform, but it would have been a lot more expensive. The problem here in Europe is there is less second hand enterprise hardware available (if I remember correctly, a compatible motherboard alone would have been ~€200, and the RAM was about the same) and importing something from outside Europe means you need to pay customs fees, which in my country adds ~30% to the price.
- 9y ago
- dis-sys 9y agoI just built myself a dual E5-2696v4 workstation last week. ebay/taobao has loads of very affordable E5-2696v4, they are not ES/QS junks but the official version provided to manufacturers. I paid $1,000 for each processor. Supermicro X10DAI motherboard is just a piece of art, as usual. They sell you this brand new beauty for $350 - it is more like running a charity given the fact that those so called "high end" consumer grade motherboard with one socket and 8 DIMM slots can easily cost you $500 or more. RAM is pretty expensive now, 128G DDR4-2133P ECC REG RAM cost around $1,000 on taobao.com, unless you buy some shitty brands to save a couple hundred $. Then you need a EEB case, a solid reliable PSU and two heatsinks, that is another $250 to spend. I can't afford a 3T RAM HP workstation, but the good news is every programmer in fact can afford a 44 cores dual E5-2696v4 workstation like the one I just built. ;)
- sireat 9y agoHow's the buying experience for computer hardware on taobao? I bought everything for a dual Xeon 2670v1 system (starting with Dell T5600 as base) from ebay and it came out to $1000 last year including $150 for 64GB of ECC RAM. Very happy with it but could definitely use an upgrade now. Dual E5-2696v4 seems like the current sweet spot for DIY.
- dis-sys 9y ago> How's the buying experience for computer hardware on taobao? pretty happy with my experience. vendors posted the stuff on the same day, delivered within 24 hours as I live in Shanghai. it might be different story if you live in other countries as the refund policy says you can return the stuff within 7 days with no questions asked, you probably can't do that within the 7 days time frame if the package need to be posted overseas. > I bought everything for a dual Xeon 2670v1 system (starting with Dell T5600 as base) from ebay and it came out to $1000 last year including $150 for 64GB of ECC RAM. I also have a dual E5-2670v1 system, actually I am posting from it now. I found a single E5-2696v4 is going to be 40-50% faster than the dual E5-2670v1, dual 2696v4 almost triples the CPU performance for my workload. this has been confirmed by both cinebench score and benchmark results of an in-house application I developed. RAM bandwidth is not going to be a big jump. > Dual E5-2696v4 seems like the current sweet spot for DIY. Dual E5-2696v3 with some firmware/bios hack to push all cores running at higher speed is probably more $ efficient. You can get a faster system that is $500 cheaper. ;)
- sytelus 9y agoI've been using Z840. Great developer machine for deep learning and heavy CPU + GPU related stuff. One of few workstations that had enough power to put in two (old) TitanX in its days. Newer one looks even better.
- majidazimi 9y agoAtom/Electron devs: Challenge Accepted.
- katastic 9y agoI can finally load the CNN webpage without adblock AND use a 30MB Excel spreadsheet at the same time!
- fdchn2016 9y agoWaiting for https://www.raptorcs.com/content/TL2WK2/intro.html https://www.raptorcs.com/content/TL2WK2/intro.html to become available and prices to then fall over a year's time.