3 ms·
It means all the main chips required for a large-scale datacenter. And many of the layers of software on top of it. Hardware: * The GPU * The GPU-GPU Fabric (N
by dweekly 3y ago
It means all the main chips required for a large-scale datacenter. And many of the layers of software on top of it.
Hardware:
* The GPU
* The GPU-GPU Fabric (NVLINK)
* The CPU
* The NIC
* The Network Fabric (infiniband)
* The Switch
And that's not even starting to get into the many layers of the software stack (CUDA, Riva, Megatron, Omniverse) that they're contributing and working to get folks to build on.