DeepSeek-R1 only has 37B active parameters. A back of the napkin calculation: 819GB/s / 37GB/tok = 22 tokens/sec. Realistically, you’ll have to run quantized

DeepSeek-R1 only has 37B active parameters. A back of the napkin calculation: 819GB/s / 37GB/tok = 22 tokens/sec. Realistically, you’ll have to run quantized to fit inside of the 512GB limit, so it could be more like 22GB of data transfer per token, which would yield 37 tokens per second as the theoretical limit. It is likely going to be very usable. As other people have pointed out, the Mac Studio is also not the only option at this price point… but it is neat that it is an option.