7 ms·
>Combined with die stacking, which allows for up to 8 dies to be stacked as a single chip, then a 40 element LRDIMM can reach an effective memory capacity of 2T
by ksec 6y ago
>Combined with die stacking, which allows for up to 8 dies to be stacked as a single chip, then a 40 element LRDIMM can reach an effective memory capacity of 2TB. Or for the more humble unbuffered DIMM, this would mean we’ll eventually see DIMM capacities reach 128GB for your typical dual rank configuration.
So on 8 Channel 16 DIMM per socket you could fit a theoretical 32TB of memory. This is insane amount of memory and great for In-Memory Database. ( How is Intel Optane going to compete? )
This makes me wonder, what makes DRAM so expensive? It is still hovering at a median price or around $3/GB compared to NAND which is less than $0.1/GB.
- baybal2 6y ago> This makes me wonder, what makes DRAM so expensive? Greed does. DRAM makers were antitrust busted at least 7 times on my memory in Taiwan, Korea, and USA.
- azinman2 6y agoGreed to me is a funny word here. If illegal antitrust actions are occurring, well that’s obviously bad for the consumer and market, but you say greed as if DRAM makers owe something to the public? They’re a technology business who exist to make money by definition. It’s not a non-profit.
- jeffbee 6y agoThat hasn't been the history of the business. DRAM makers are state-sponsored strategic enterprises which do not act according to rational economic theories.
- black_puppydog 6y agoExactly. Compare that to privately held corporations, which would never think to illegally keep prices up through collaboration, just because they can reasonably expect to get away with it. /s
- rimjongun 6y agoSo it’s either or? Both can’t be right? Geez. Straw man much?
- black_puppydog 6y agowell you can either be state-sponsored or not. if GP is bringing up state-sponsoring as a supposed source of irrationality then yeah I'm assuming that they presume privately held corporations would do better. that being said, I do admit my post was sarcastic, but it also did mention what the problem here is (besides a much broader discussion about captialism) which is that they can rationally expect to get away with this. State-sponsored ones because their interests are the national interest (to an extent) and privately held ones because they're usually able to effectively capture their regulators.
- deleted 6y ago[deleted]
- derefr 6y agoIf that's the only reason, then you'd think companies like Apple with dedicated fab timeshare could cut costs by printing their own RAM chips, rather than buying them. And It's not like DRAM contains any complex IP they'd need to license—if you can lay out a CPU, you can lay out RAM.
- grandinj 6y agoThe IP is mostly in the production process, not the circuit itself. They need to get (relative to logic chips) very low failure rates to turn a profit, which requires very extensive tuning of the manufacturing process.
- psurge 6y agoMy understanding is that DRAM processes are sufficiently different from logic processes that they tend to get dedicated fabs. So then companies like Apple would have to buy fab timeshare from RAM manufacturers that have no incentive (as far as I can see) to let them produce DRAM for less than whatever the bulk pricing is.
- baybal2 6y agoYes
- derefr 6y agoWhat's the reason, then, that anyone with the capital to do so (again, e.g. Apple) doesn't just build a RAM fab, to both get cheap RAM for themselves, and join the cabal selling marked-up RAM to others? Seems like RAM manufacturing is like building a casino: expensive to do, but basically a sure bet.
- deleted 6y ago[deleted]
- wtallis 6y agoThe problem is that you need to have $10+B to throw at the problem after you license patents from the incumbents, and even then you'll end up being behind them technologically by the time your fab is up and running, so your marginal costs won't be appreciably better than contracting with the existing manufacturers for their more advanced memory. You could theoretically spend several times more than that to try to get ahead over the course of two or three generations, but for that kind of money you could just as easily secure some very preferential pricing from one or more of the incumbents, thereby ensuring that everyone else trying to put a lot of RAM into a PC has to pay more. The most viable path to establishing a new leading-edge competitor in this space is for a government to throw lots of money at the problem, knowing that it'll be years at best before it produces anything competitive, but having the advantage of being able to more or less ignore IP issues and having a potential demand far higher than any one memory customer can produce on its own. China is doing this for the NAND market, too.
- lend000 6y agoThe processes to form NAND and DRAM are completely different. DRAM relies on creating non-leaking capacitors which are highly difficult to manufacture at such a small scale. NAND benefits from innovations in the CPU lithography space since it's essentially all transistor based. Why would you expect them to have the same price, unless you knew nothing about the technology? Also, there are plenty of distinct competitors in the DRAM space. Do you have a source suggesting Micron and Samsung are engaging in price fixing together?
- kasabali 6y ago"Plenty" of distinct being Samsung, Micron and Hynix. They are not necessarily price fixing illegally. It's just that they all keep their production and capacity expansions closely in check to not ever let prices down. That and in rare cases when prices are down due to unexpected decline in shipments they're all very swift to shift wafers to produce something else. Feel free to dig DRAMeXchange reports for for details.
- amINeolib 6y agoSamsung is one of the worst companies. Among the BP, AT&T, Comcast, and Apple tier evils. I'm not sure how they have survived bad press, but Samsung is not a good company.
- wtallis 6y ago> NAND benefits from innovations in the CPU lithography space since it's essentially all transistor based. It's really not, especially in the 3D NAND flash era where only one manufacturer is still using a floating gate cell. It's so thoroughly not transistor based that the Chinese upstart's claim to fame is that they fabricate the transistors on an entirely different wafer from the memory cells, and glue them together later. It's best to think of NAND, DRAM and logic as three separate categories that each require a very different mix of tools in the fab, especially on the back-end. (But you won't be finding EUV or quad-patterning in the front-end of a NAND fab, either.)
- vitus 6y agoIf the difficulty of DRAM is in creating capacitors at that size, why haven't we seen a shift toward SRAM (6T, for instance), which is purely transistor-based? Sure, you have to sacrifice more transistors for the same capacity, but newer processes can fit more on the chip, right? I recall from computer architecture classes that the benefit of DRAM is the ability to use fewer transistors, but if transistors are cheap... (I'm sure I'm missing something here. Power consumption / heat generation? I also never really understood why SRAM continues to be so expensive, when it seems like it would obviously benefit from smaller processes.)
- markandrewj 6y agoThis is why even though memory was becoming dirt cheap, prices started to spike in the last few years. There are also less manufactures now as a result of buyouts and mergers.
- LargoLasskhyfv 6y agoAdd the European Union, Infineon. [0] https://www.finanznachrichten.de/nachrichten-2010-05/16940239-eu-kommission-verhaengt-millionenstrafe-gegen-infineon-016.htm https://www.finanznachrichten.de/nachrichten-2010-05/1694023...
- jeffbee 6y agoYou would need a new CPU that doesn't yet exist to address 32TB of memory per socket. Existing parts can address 4TB. x86-64 has an ultimate system limit of 256TB, due to its 48-bit virtual address space. Also worth considering that 32TB of DRAM would draw over 12kW, just sitting there.
- kryptiskt 6y agoIce Lake added 5-level paging and 56-bit pointers, so they can address 128 PB: https://en.wikipedia.org/wiki/Intel_5-level_paging https://en.wikipedia.org/wiki/Intel_5-level_paging
- messe 6y agoHey, I'm a bit late, but it's 57-bits. On 64-bit systems page tables have 512 = 2^9 entries and page frames are 4096 = 2^12 bytes long. So the number of bits in an n-level system is 9n + 12. 9x5 + 12 = 57 On 32-bit systems the number of PT entries was 2^10, which is why they could have a 2-level system. 10x2 + 12 = 32.
- messe 6y ago> You would need a new CPU that doesn't yet exist to address 32TB of memory per socket. Existing parts can address 1TB (Intel) or 4TB (AMD). x86-64 has an ultimate system limit of 256TB, due to its 48-bit virtual address space. That's the virtual address space. A page table entry has enough bits to have a 64-bit physical address space, it just wouldn't be able to have it all mapped at once in the same virtual address space. Although CPUs don't have 64 physical address lines yet, there's nothing fundamental in the x86 architecture preventing them from doing so. Intel have already implemented 5-level paging, which would give a 2^57 bit virtual address. Also, this wouldn't be the first time that the x86 has supported more physical memory than virtual. PAE allowed for 64GB of RAM on a system with a 32-bit virtual address space.
- jeffbee 6y agoIt costs them money to add physical address pins, though. While we're here I hope anyone can explain to me why Cooper Lake Xeon parts are listed as supporting 4.5TB of DDR4. Answering self: the 4.5TB support is mostly Optane memory, not DDR4.
- altmind 6y agoyou can already have 128gb per DIMM with DDR4. not sure if its up to spec, but it works usually. 128gb dimms are more than double the price of 64gb dimms, so it not always economically viable unless you need max memory density.
- dathinab 6y ago> Intel Optane going to compete Price ;=) Also Optan drives (over PCI) are probably still interesting for some applications due to low latencies as far as I remember.
- elihu 6y agoI'm not an expert, but my understanding of it is that DRAM is mostly just banks of capacitors with some transistors to control when they get recharged or drained. Making capacitors smaller is problematic, because it would decrease the capacitance and require more frequent updates to prevent data loss. So, DRAM doesn't really benefit as much from process shrinks as CPUs do. DRAM does get better and cheaper over time, but the physical constraints on the problem are different.
- klodolph 6y agoA DRAM cell is a single capacitor and single transistor. DRAM benefits from process shrinking because smaller transistors require less charge to switch. The way DRAM is read is by dumping the charge into a transistor’s gate capacitor. Yes, you also have to deal with leakage current and stray capacitance and the like.
- cookienapper 6y agoTo the best of my knowledge: with (non-volatile) NAND; 1ms response times vs (volatile) DRAM; 1ns response times... For context; there's 1 million ns in 1 ms. They're in completely different leagues in terms of speed and they're used for very different applications. While both benefit greatly from economy of scale; the manufacturing tolerances, equipment, etc etc used influences pricing; but I'm not an engineer... so maybe someone here can chime in on that :)
- deleted 6y ago[deleted]
- imtringued 6y agoThose numbers seem awfully pessimistic for NAND and too optimistic for DRAM. 1ms is what you get from a fast HDD. SATA SSDs usually manage 100µs and NVMe usually has 10µs or less latency (as low as 2.8µs). DDR4-3600 usually has around 10ns CAS latency which only measures the time needed to read data from a DRAM cell but doesn't consider how much time it takes for that data to travel to a CPU. Before a CPU looks up data it has to first check the L1, L2, L3 caches which can take 30ns and then another 20ns for the memory controller to process the DRAM request. So it's 60ns (10+30+20) for a main memory access. The difference between 10µs and 60ns is merely a factor of 167 not 1 million. The only take away I have from your comment is that you somehow confused DRAM with the L1 cache and SSDs with HDDs. That's the only way one could possibly arrive at your numbers. I have used rounded numbers for illustrative purposes. They might be off by 30% or more but they are within the right order of magnitude.
- boznz 6y agoYou can do static RAM this way eg cache but off chip is dynamic ram which is a slightly different process as it uses very small capacitance to store the charge, I also think mixing the two processes on one die is the issue cache is so small relative to dram
- GordonS 6y agoIs anyone here in the industry? Is there any new tech or process on the horizon that could bring down the price of DRAM?
- kasabali 6y agoTech or process hasn't been the main reason for high DRAM progress for a long time.
- qes 6y ago> How is Intel Optane going to compete? You should see how fast Optane will copy a project folder full of node_modules, bin, etc.. Blows the doors off an Evo Plus. That said, probably not worth the premium for the vast majority of uses.
- Rafuino 6y agoI assume you're talking about Optane SSDs, not Optane PMem, given the Evo Plus comparison.
- imtringued 6y agoYou can avoid that problem by not using node and npm. I have used create-react-app once for a project and that was bad enough for me to stay away from the entire ecosystem.
- qes 6y ago> You can avoid that problem by not using node and npm. Not realistically; that would just introduce more problems than what I would avoid. I have better things to do with my time than try to avoid npm. JS projects are only a small fraction of my work anyway.
- wmil 6y agoPart of it is that the demand isn’t there for extreme densities. Producers are focussing on speed. Look at base ram in MacBooks, the growth over time is pretty slow.