2 ms·
At this point I wonder why arent CPU vendors experimenting with memory compression. Works great in GPUs. This would have a chance of cutting latency if decompre
by rasz 7y ago
At this point I wonder why arent CPU vendors experimenting with memory compression. Works great in GPUs. This would have a chance of cutting latency if decompressing a cache line is faster than loading whole thing from ram.
- blattimwind 7y agoTexture compression works because GPUs are bandwidth-limited in regards to memory. It doesn't really help you when you are latency-limited, because the latency-to-first-byte is the same or slightly larger for compression.
- rasz 7y agoYou arent always interested in first byte, besides CPUs operate on whole cache lines. Doesnt matter where the byte is, you will have to wait whole load anyway. We already have memory encryption. "AMD mentioned a latency increase of 7-8 ns when memory encryption is enabled, which results in a 1.5% performance hit in SPECInt" Here we would be compensating with smaller data transfers. Wouldnt have to be an amazing algorithm, even RLE would probably give latency improvements.