2 ms·
VRAM speed is a major factor. Even ddr5 with 4 channels would be slow compared to current GDDRs.
by dur-randir 3y ago
VRAM speed is a major factor. Even ddr5 with 4 channels would be slow compared to current GDDRs.
- codedokode 3y agoThat's correct, but if you are, for example, multiplying two 1024x1024 matrices (typical for ML loads) then you need to perform roughly 1B operations on 1M numbers. There is no need for loading lot of data. So we can do without fast memory in this case, can't we? Hopefully the cache and registers of GPU can handle this.