4 ms·
I actually want an AI PC, but not the kind that are being marketed. Basically I want to see a cheaper Mac M3 Ultra with about 128GB unified memory combined with
by karmakaze 1y ago
I actually want an AI PC, but not the kind that are being marketed. Basically I want to see a cheaper Mac M3 Ultra with about 128GB unified memory combined with discrete-performance GPU on-board. AMD is moving in that direction and might get there in 3 or so generations. Could perhaps get away with less hardware if software improves before then.
Nvidia's DGX Spark is a bit of a joke with only 273 GB/s memory bandwidth which is less than a 10 year old Radeon Fury X with 512 GB/s or the current RTX 5090's 1.79 TB/s.
- eigenspace 1y agoAMD is there right now with their Strix Halo processors. E.g. https://frame.work/de/en/desktop https://frame.work/de/en/desktop 128 GB of RAM, gigantic memory bandwidth, a great GPU, and a great CPU.
- hnuser123456 1y agoLooks like Ryzen AI Max is quad-channel soldered DDR5-8000, which is 256 GB/s. Not bad, but if use a model that fills that 128GB, you're only getting 2 tokens per second.
- phonon 1y agoMemory bandwidth is 256 GB/s, which is shared by CPU, GPU, and NPU. So not comparable to a discrete GPU.