3 ms·
On a hypothetical 70b q4 model, the Ryzen AI Max+ 395 (128GB memory with 96GB allocated to iGPU) delivers ~2–5 tokens/sec, slightly trailing the M4 Max’s ~3–7 t
by karmakaze 1y ago
On a hypothetical 70b q4 model, the Ryzen AI Max+ 395 (128GB memory with 96GB allocated to iGPU) delivers ~2–5 tokens/sec, slightly trailing the M4 Max’s ~3–7 tokens/sec. The next generation for AMD I expect can easily catch up to or surpass the M4 Max.
A pair of MaxSun/Intel Arc B60 48GB GPUs (dual 24GB B580's on one card) for $1200 each also outperforms the M4 Max.
- insane_dreamer 1y ago> A pair of MaxSun/Intel Arc B60 48GB GPUs (dual 24GB B580's on one card) please point me to the laptop with these
- tyleo 1y agoThis isn’t a great point. “A hypothetical model with hypothetical hardware will beat Apple on a hypothetical timeline.” The tangible hardware you point out is $2,400 for two niche-specific components vs the Apple hardware which benefits more general use cases.