5 ms·
Okay, probably a stupid question, but solid state memory can be pretty dense: why don't we have huge caches, like a 1GB cache? As I understand it, cache memory
by ineedasername 6y ago
Okay, probably a stupid question, but solid state memory can be pretty dense: why don't we have huge caches, like a 1GB cache? As I understand it, cache memory doesn't put off heat like the computational part of the chip does, so heat dissipation probably wouldn't increase much with a larger chip package.
- coryrc 6y agoCost. Area is what you pay for (at a given transistor size).
- semi-extrinsic 6y agoWell, the latest AMD Epyc has 256 MB L3 cache, so we're getting there.
- gameswithgo 6y agobut any given core only has access to 16 soon to be 32mb
- fulafel 6y agoin Zen 1 and Zen 2, cores have direct or indirect access to the shared L3 cache in the same CCX. In the cross-CCX case the neighboring CCX cache can be accessed over the in-package interconnect without going through system DRAM.
- samoa42 6y agothis! when i started with computers, they had a few KB of L2 cache, L3 did not exist. Main Memory was a few MB.
- atq2119 6y agoSRAM is 6 transistors per bit, so you're taking about 48 billion transistors there, and that's ignoring the overhead of all the circuits around the cells themselves. DRAM is denser, but difficult to build on the same process as logic. That said, with chiplets and package integration becoming more common, who knows... One die of DRAM as large cache combined with a logic die may start to make more sense. It's certainly something people have tried before, it just didn't really catch on.
- Pet_Ant 6y ago> DRAM is denser, but difficult to build on the same process as logic. What makes it so difficult to have on the same chip?
- elihu 6y agoI don't know the details, but the manufacturing process is pretty different. Trying to have one process that's good at both DRAM and logic at the same time is hard, because they optimize for different things.
- janekm 6y agoOr, well, how about putting all your ram on the package as Apple says they are doing with the M1?
- gameswithgo 6y agothe bigger the cache the slower it gets so ram is your 1gb cache
- tomxor 6y agoAre you are referring to latency due to propagation delay where the worst case increases as you scale? Would you mind elaborating a bit? I'm not following how this would significantly close the gap between SRAM and DRAM at 1GB. Since an SRAM cell itself is generally faster than a DRAM cell, and I understand that circuitry beyond an SRAM cell itself is far simpler than DRAM. Am I missing something?
- MobiusHorizons 6y agoI am sure there are many factors, but the most basic one is that the more memory you have, the longer it takes to address that memory. I think it scales with the log of the ram size, which is linearly with the number of address bits.
- psykotic 6y agoLog-depth circuits are a useful abstraction but the constraints of laying out circuits in physical space imposes a delay scaling limit of O(n^(1/2)) for planar circuits (with a bounded number of layers) and O(n^(1/3)) for 3D circuits. The problem should be familiar to anyone who's drawn a binary tree on paper.
- Dylan16807 6y agoWith densities so high, and circuit boards so small (when they want to be), that factor isn't very important here. We regularly use chips with an L3 latency around 10 nanoseconds, going distances of about 1.5 centimeters. You can only blame a small fraction of a nanosecond on the propagation delays there. And let's say we wanted to expand sideways, with only a 1 or 2 nanosecond budget for propagation delays. With a relatively pessimistic assumption of signals going half the speed of light, that's a diameter of 15cm or 30cm to fit our SRAM into. That's enormous.
- emn13 6y agoNand flash is pretty dense, but way too slow. Sram is fast but not at all dense, needing 6 transistors per bit. For reference: https://en.m.wikipedia.org/wiki/Transistor_count https://en.m.wikipedia.org/wiki/Transistor_count lists all the largest cpu as of 2019 amd's epyc Rome at 39.54 billion MOSFETs, so even if you replaced the entire chip with Sram you wouldn't even quite reach 1GB! Dram would be enticing, but the details matter.
- chemmail 6y agoNand is nonvolatile and the tradeoff with that is write cycles. We have an inbetween in the form of 3D Xpoint (Optane), Intel is still trying to figure out the best way to use it. It currently like an L6 cache after system DRAM.
- thu2111 6y agoWell not just Intel. Optane is a new point in the memory hierarchy. That has a lot of implications for how software is designed, it's not something Intel can do all by itself.