3 ms·
> I can get a 128 core system today, if I need the density. 256 core now with bergamo.
by ben-schaaf 3y ago
> I can get a 128 core system today, if I need the density.
256 core now with bergamo.
- latchkey 3y agoThis is what we have in our MI300x box. 2x9754. Beast of a CPU. Intel has nothing even close.
- zer00eyz 3y agoOHHHH That's like 500 cores in one box? cores/threads total? How much ram? disk? do you know the all in cost and rack U? There are lots of folks whose entire production infrastructure is half that core count or less.
- latchkey 3y agoWhole box is a beast. 3TB ram, 122TB nvme... plus the 8x MI300x (192gb/each). 2x 400G cx7 NICs. Here are the CPU specs: https://www.amd.com/en/products/cpu/amd-epyc-9754 https://www.amd.com/en/products/cpu/amd-epyc-9754 We went with higher cores vs. higher clocks/cache due to wanting multi-tenancy on this box. MI300x is so new that we wanted to be able to give people 1-2 gpus at a time (via VM/pcie pass through), so we figured more cores are better for now. In the future, we will buy a mix of different CPUs (including Intel as well). Yes, of course I know the costs. It ain't cheap. ;-)
- zer00eyz 3y ago>> Yes, of course I know the costs. It ain't cheap. ;-) I hate that we have to be this way about prices (its stupid) Core density is through the roof... Your one box today is the equal of whats likely a 15x multiplier. 15 years ago that much compute would have spanned 2 racks. Or jammed one full of blade servers (and they were expensive). It's in what? 4? 8? u of space?
- latchkey 3y ago8u. Whole box weighs 300+lbs.
- alcover 3y agoThose specs amaze me. How far we have gone for those who remember 90's computing !