2 ms·
but is a competitor to the $4000 Mac Studio with 96 GB. The slow memory bandwidth is a bummer, though. Not really. The M4 Max has 2x the GPU power, 2.13x the b
by aurareturn 2y ago
but is a competitor to the $4000 Mac Studio with 96 GB. The slow memory bandwidth is a bummer, though.
Not really. The M4 Max has 2x the GPU power, 2.13x the bandwidth, faster CPU.
$2000 M4 Pro Mini is more of a direct comparison. The Mini only has 64GB max ram but realistically, a 32B model is the biggest model you want to run with less than 300 GB/s bandwidth.
- Tepix 2y agoYou will be limited to a much smaller context size with half the RAM even if you're using a smaller model.