3 ms·
The 25GB/s corresponds to the fastest speed a DDR4 can send memory. That said, any nontrivial computation is unlikely to keep up with that speed (e.g. 64-bit d
by beagle3 8y ago
The 25GB/s corresponds to the fastest speed a DDR4 can send memory.
That said, any nontrivial computation is unlikely to keep up with that speed (e.g. 64-bit data will be ~3GD/s, so whatever computation you do has to fit in amortized 1 cycle on a 3Ghz clock, or the CPU is the bottleneck)
GD=GigaDatum
- taeric 8y agoI'm curious how much of a contributing factor this is to why many deep learning pipelines use smaller floats. Specifically, I "knew" that the throughput some math operations was actually greater than 1. That said, I have not kept up with which operations. I would not have expected the floating point units to be the fast ones. Again, thanks for sticking with me in this thread. I learned a bit. Hoping to come up with ways to play with this knowledge. :)