3 ms·
From VRAM to the tensor cores and back. On a modern GPU you can have 1-2tb moving around inside the GPU every second. This is why they use high bandwidth memor
by Legend2440 10mo ago
From VRAM to the tensor cores and back. On a modern GPU you can have 1-2tb moving around inside the GPU every second.
This is why they use high bandwidth memory for VRAM.
- Zambyte 10mo agoThis makes sense now, thanks!