3 ms·
It's in the eye of the beholder... A CPU + GPU system is arguably a non-shared-memory multiprocessor. Systems running on AWS Lambda or Kubernetes or Kafka migh
by fulafel 9y ago
It's in the eye of the beholder... A CPU + GPU system is arguably a non-shared-memory multiprocessor.
Systems running on AWS Lambda or Kubernetes or Kafka might also count as non-shared-memory multiprocessors.
- ghaff 9y agoYep. The processors are spread around different boxes in a supercomputer or a Google datacenter but, at some level, that's just an implementation detail. There was a time about--maybe a bit over--10 years ago when there were a whole lot of distributed memory processors/systems/hybrids coming onto the market. SciCortex, BlueGene, Cell, Azul, Tigera (I think) coming onto the market, as well as SMP chips like Sun's Niagara. The general problem is that, by the time these specialized designs would get to market, Moore's Law would have turned another crank and made all the work moot. I do think with CMOS scaling slowing down/dying, we'll see more specialized designs even if they're a pain for programmers and system architects because what choice do we have? We already see it with GPUs, FPGAs, and so forth.