256GB/s is on par with the M4 Pro at a much lower price. You could run R1 671B using unsloth’s quantized version that fits in <80GB. Not sure why that would be

256GB/s is on par with the M4 Pro at a much lower price. You could run R1 671B using unsloth’s quantized version that fits in <80GB. Not sure why that would be a benchmark though, there’s nothing that can run the model at full precision right now except for (very slow) server hardware.