3 ms·
I think parents point is that NVLink no longer ships with consumer cards. Before you could buy two cards + a cable between them, and software can treat them as
by diggan 2y ago
I think parents point is that NVLink no longer ships with consumer cards. Before you could buy two cards + a cable between them, and software can treat them as one card. Today you need software support for splitting between the cards, unless you go for "professional" cards or whatever they call them.
- Gracana 2y agoMaybe that's what they meant, and it'd be cool if nvidia still offered that on consumer cards, but thankfully you don't need it for LLM inference. The traffic between cards is very small.
- diggan 2y agoIsn't the issue that the software needs to explicitly add support for it now, compared to yester-yesterday when you could just treat them as one in software?