3 ms·
Meanwhile the GB300 used by hosted llms: GPU Memory Bandwidth: 7.1 TB/s Interconnect Bandwidth: 900 GB/s bidirectional https://pi3g.com/nvidia-gb300-specifica
by toasty228 2mo ago
Meanwhile the GB300 used by hosted llms:
GPU Memory Bandwidth: 7.1 TB/s
Interconnect Bandwidth: 900 GB/s bidirectional
https://pi3g.com/nvidia-gb300-specifications-including-memory-bandwidth-and-llm-benchmarks-based-on-2026-systems/ https://pi3g.com/nvidia-gb300-specifications-including-memor...
If you think M7 will hit even 15% of these speeds you're very optimistic.