Moore's law for RAM capacity has begun slowing over the past few years. The 64 TB system you mention is from six years ago, right about when Moore's law began t

Moore's law for RAM capacity has begun slowing over the past few years. The 64 TB system you mention is from six years ago, right about when Moore's law began tapering. If Moore's law had continued doubling RAM capacity every eighteen months, we should have seen four doublings, up to 1PB. But that's not a machine we're seeing. Notably, the bandwidth of RAM does not and has not been following Moore's law, improving linearly, and the latency is more or less constant. So as workloads scale up in size, performance will get worse and worse and worse, until "just buy more RAM" no longer solves the problem. Similar to how swap partitions used to be a thing, but performance is now so bad that swap can't be used as cheap RAM anymore. https://www.semanticscholar.org/paper/Understanding-and-Improving-the-Latency-of-Memory-Chang/a5807e24d7f90f398e7ad8afe221f8edaf4e74e3/figure/0 https://www.semanticscholar.org/paper/Understanding-and-Impr...