2 ms·
What is unified ram? RAM and VRAM as one thing?
by tarr11 1mo ago
What is unified ram? RAM and VRAM as one thing?
- deleted 1mo ago[deleted]
- lynndotpy 1mo agoYep, exactly. It's just one shared pool of RAM with zero-copies necessary.
- deleted 1mo ago[deleted]
- AbsurdCensor 1mo agoBig ole pool of very fast ram that can be accessed by the CPU and GPU. Lets you run larger models. AMD does the same thing with Strix Halo. I have a 128gb machine at home, and have had difficulties running 120b models, but 70b and below run pretty well.
- dannyw 1mo agoAMD Strix Halo unified memory still requires allocating X to GPU, x to CPU at UEFI. So not as flexible as apple's unified memory.
- EgregiousCube 1mo agoNot in Linux! See setting GTT: https://rocm.docs.amd.com/en/docs-7.2.0/how-to/system-optimization/strixhalo.html https://rocm.docs.amd.com/en/docs-7.2.0/how-to/system-optimi...
- Havoc 1mo ago> Big ole pool of very fast ram It’s more that it’s a very parallel architecture than fast. The LPDDR5X under the hood is slower than what you’d find in a graphics card vram of years ago That’s why you get consumer macs with 512gb while GPU makers are reluctant to give you more than 16gb unless you pay dearly. It’s not the same kind of mem
- Zylokloto 1mo agoIn best case its also on-chip high speed ram.
- fsuts 1mo agoYes