3 ms·
it's 16TB of DDR5 btw
by tuananh 2y ago
it's 16TB of DDR5 btw
- metadat 2y agoYes, 128x128. Good for a database, maybe. What else?
- rustcleaner 2y agoLarge Language Models.
- rustcleaner 2y agoQubes OS.
- moomoo11 2y agoDumb question but why don’t we see more cracked out high memory machines? I mean like 1 petabyte RAM. Or do these already exist
- guenthert 2y agoI'd think the market share for applications which need huge amount of space, but little CPU processing power and memory transfer rate is rather small. Lenovo's slides indicate that they foresee this server be used for in-memory data bases. Weren't there also distributed fs where the meta-data server couldn't be scaled out?
- eqvinox 2y agoWe don't see more of these machines because most tasks are better served by a higher number of smaller machines. The only benefit of boxes like this is having all of that RAM in one box. Very few use cases need that.
- moomoo11 2y agoWould be fun for a graph db
- smolder 2y agoServing remote desktops to several hundred developers. Maybe a video content server for a netflix or youtube type business. Hosting a large search index? Some kind of scientific computing?
- HeatrayEnjoyer 2y agoA half dozen GPT-4 instances
- metadat 2y agoLLM inference processors (GPUs) don't use DDR, it uses special, costly stacked HBM ram soldered to the board. I tested out running Llama on a 512GB machine, it's rather slow and inefficient. Maybe 1-token/sec.
- guenthert 2y agoNumeric simulation (HPC). Some, not all, simulations need lots of memory. In 2018 larger servers running such had 1TiB, so I'm not the least surprised that six years later it's 16.