3 ms·
For comparison, a Threadripper Pro 5000 workstation with 8x DDR4 3200 has 204.8GB/s of memory bandwidth. The Threadripper Pro 7000 with DDR5-5200 can achieve 32
by Tepix 2y ago
For comparison, a Threadripper Pro 5000 workstation with 8x DDR4 3200 has 204.8GB/s of memory bandwidth.
The Threadripper Pro 7000 with DDR5-5200 can achieve 325GB/s.
And no, manaskarekar, the M4 Max does 546 GB/s not GBps (which would be 8x less!).
- wtallis 2y ago> And no, manaskarekar, the M4 Max does 546 GB/s not GBps (which would be 8x less!). GB/s and GBps mean the same thing, though GB/s is the more common way to express it. Gb/s and Gbps are the units that are 8x less: bits vs Bytes.
- deleted 2y ago[deleted]
- hmottestad 2y agoThanks for the numbers. Someone here on hackernews got me convinced that a Threadripper would be a better investment for inference than a MacBook Pro with a M3 Max.
- leptons 2y agoB = Bytes, b = bits. GB/s is the same thing as GBps The "ps" means "per second"