3 ms·

Well I'll be... Though the renderings indicate that this is a CXL controller connected to DRAMs on the back end. It makes sense, since the front end logic for

Well I'll be... Though the renderings indicate that this is a CXL controller connected to DRAMs on the back end. It makes sense, since the front end logic for CXL is die area intensive. This is basically an SSD without all of the complexity of wear leveling. > The extra latency is estimated to be no worse than a NUMA hop I was almost going to mention that in my previous comment and point out that this might be a thing in enterprise applications where SRAM is plentiful, but not likely to outright replace DDR in most consumer computing devices as the parent comment seemed to suggest.

pbalcer 4y ago
> This is basically an SSD without all of the complexity of wear leveling. With all the benefits of an enterprise SSD (EDSFF in most cases) form factor. And that's what data center folks want. > not likely to outright replace DDR in most consumer computing devices Right. I expect that CXL will initially be deployed as an internal transparent optimization for cloud providers and large data centers, with the latency and complexity (to an extent) hidden at hypervisor/orchestration layers. Some sophisticated software might have special support. Eventually we might get S3-like disaggregated memory services for cloud instances enabled by pooling (pure speculation on my part).
jsmith45 4y ago
The potential benefits of this may vary though depending on how the OS exposes things. For example, exposing this as a ram disk while possibly useful is not really optimal. Treating it more like NUMA ram, that simply lacks any cores where the memory is "local", could be more viable. The OS could be programmed to shuffle out memory that is not frequently used over to there, as a faster alternative to paging to disk, etc. Some new madvise calls to let apps mark regions as not latency critical giving the OS permission to move the memory over even if it is frequently accessed could also be interesting.

pbalcer 4y ago

> This is basically an SSD without all of the complexity of wear leveling. With all the benefits of an enterprise SSD (EDSFF in most cases) form factor. And that's what data center folks want. > not likely to outright replace DDR in most consumer computing devices Right. I expect that CXL will initially be deployed as an internal transparent optimization for cloud providers and large data centers, with the latency and complexity (to an extent) hidden at hypervisor/orchestration layers. Some sophisticated software might have special support. Eventually we might get S3-like disaggregated memory services for cloud instances enabled by pooling (pure speculation on my part).

jsmith45 4y ago

The potential benefits of this may vary though depending on how the OS exposes things. For example, exposing this as a ram disk while possibly useful is not really optimal. Treating it more like NUMA ram, that simply lacks any cores where the memory is "local", could be more viable. The OS could be programmed to shuffle out memory that is not frequently used over to there, as a faster alternative to paging to disk, etc. Some new madvise calls to let apps mark regions as not latency critical giving the OS permission to move the memory over even if it is frequently accessed could also be interesting.