3 ms·
Whole box is a beast. 3TB ram, 122TB nvme... plus the 8x MI300x (192gb/each). 2x 400G cx7 NICs. Here are the CPU specs: https://www.amd.com/en/products/cpu/amd
by latchkey 3y ago
Whole box is a beast. 3TB ram, 122TB nvme... plus the 8x MI300x (192gb/each). 2x 400G cx7 NICs.
Here are the CPU specs: https://www.amd.com/en/products/cpu/amd-epyc-9754 https://www.amd.com/en/products/cpu/amd-epyc-9754
We went with higher cores vs. higher clocks/cache due to wanting multi-tenancy on this box. MI300x is so new that we wanted to be able to give people 1-2 gpus at a time (via VM/pcie pass through), so we figured more cores are better for now.
In the future, we will buy a mix of different CPUs (including Intel as well).
Yes, of course I know the costs. It ain't cheap. ;-)
- zer00eyz 3y ago>> Yes, of course I know the costs. It ain't cheap. ;-) I hate that we have to be this way about prices (its stupid) Core density is through the roof... Your one box today is the equal of whats likely a 15x multiplier. 15 years ago that much compute would have spanned 2 racks. Or jammed one full of blade servers (and they were expensive). It's in what? 4? 8? u of space?
- latchkey 3y ago8u. Whole box weighs 300+lbs.
- alcover 3y agoThose specs amaze me. How far we have gone for those who remember 90's computing !