5 ms·
100 Titan Vs = $300k. And the big deal about this system is the NvSwitch which allows the GPUs to appear to software as a single huge GPU.
by steve_musk 9y ago
100 Titan Vs = $300k. And the big deal about this system is the NvSwitch which allows the GPUs to appear to software as a single huge GPU.
- chrischen 9y agoSo you can run a single neural net model that can use > 12gb memory?
- dogma1138 9y agoYou can already do that with Pascal since it supports unified memory you have an address space of 49bits. Now it’s even faster since you won’t have to fetch pages from system memory or worse. But this isn’t new NVLINK supported memory unification of this sort since it’s introduciton but never in this scale. I’m pretty sure that if their numbers to be believed they have just made the worlds “fastest” single switched fabric.
- riku_iki 9y agoAnd what are those numbers for fabric speed?..
- dogma1138 9y ago900GB/s (GByte) bidirectional.
- riku_iki 9y agoOh, that's very impressive!
- kingosticks 9y agoDo you think they actually mean 900Gb/s (Gbit) here? 18 ports of todays ~50Gb/s serdes would give 900Gb/s. And that'd be twice the bandwidth of their Nvlink 2.0 stuff (~25Gb/s), which would seem a reasonable evolution. Edit: Turns out that a single Nvlink 3.0 port is 8-bits wide and since 144 50Gb/s serdes on a (big) chip is perfectly doable - 900GB/s must be correct.
- ethbro 9y agoThe article notes it's a 2B transistor switch chip... which boggles the mind.
- imtringued 9y agoPCIe 3.0 x16 already is capable of more than 100gbps per port. 900gbits total bandwidth for 18 NVLink ports would be abysmally slow.