> The primary issue here is that it is expensive to move data between processing units I'm thinking of them all on a chip (or even same core) with external DRA

> The primary issue here is that it is expensive to move data between processing units I'm thinking of them all on a chip (or even same core) with external DRAM shared, and cpu cache shared. > and having them share memory has all the common problems with race conditions and cache invalidation That's pretty well a solved problem, or modern OS's wouldn't work. > providing more capabilities on the same processor looks like it will win out for some time yet I agree, for now, tomorrow's cpu will look like today's. But further out, I expect my view might perhaps start coming to pass.