Might the solution be to give the programmer "manual" access to all levels of memory, so that we can choose which memory to use when, from what core. For the s

Might the solution be to give the programmer "manual" access to all levels of memory, so that we can choose which memory to use when, from what core. For the same reason that the OS should not decide which core runs what thread; you cannot progress unless you give people the power to improve things. In extremis this also means the mono-kernel has to go, but then we're talking big a change. Anyway I don't think the improvements are going to come from hardware or software only, we need to improve both simultaneously together, which is complex and often requires one (or atleast very few) person(s) to do the job.