3 ms·
It's gotta be swapping or something. The 4090 is faster (and far more expensive) than Strix Halo in every way.
by wmf 2y ago
It's gotta be swapping or something. The 4090 is faster (and far more expensive) than Strix Halo in every way.
- sliken 2y agoAfter digging it looks like 70B Q4 requires 35GB or so. So yes the AMD comparison is a strix halo not swapping vs a 4090 that is swapping. Seems kinda misleading, but is a real advantage for larger models.