3 ms·
Crypto mining didn't require significant bandwidth to the card. Mining-oriented motherboards typically only provisioned a single lane of PCIe to each card, and
by duskwuff 3y ago
Crypto mining didn't require significant bandwidth to the card. Mining-oriented motherboards typically only provisioned a single lane of PCIe to each card, and often used anemic host CPUs (like Celeron embedded parts).
- renewiltord 3y agoExactly. They'd use PCIe x1 to PCIe x16 risers with power adapters. These require high-bandwidth.
- nottorp 3y agoOh. Shows I wasn't into that. I did once work with a crypto case, but yes, it was one motherboard with a lot of wifis and we still didn't need the pcie lanes.
- cjbprime 3y agoDoes LLM inference require significant bandwidth to the card? You have to get the model into VRAM, but that's a fixed startup cost, not a per-output-token cost.