3 ms·
AMD is there right now with their Strix Halo processors. E.g. https://frame.work/de/en/desktop https://frame.work/de/en/desktop 128 GB of RAM, gigantic memory
by eigenspace 1y ago
AMD is there right now with their Strix Halo processors.
E.g. https://frame.work/de/en/desktop https://frame.work/de/en/desktop 128 GB of RAM, gigantic memory bandwidth, a great GPU, and a great CPU.
- hnuser123456 1y agoLooks like Ryzen AI Max is quad-channel soldered DDR5-8000, which is 256 GB/s. Not bad, but if use a model that fills that 128GB, you're only getting 2 tokens per second.
- phonon 1y agoMemory bandwidth is 256 GB/s, which is shared by CPU, GPU, and NPU. So not comparable to a discrete GPU.