4 ms·
Yes. This has been tried before. A lot. It's straightforward to put a lot of loosely coupled compute units on a single chip, or at least a single box. The quest
by Animats 5y ago
Yes. This has been tried before. A lot. It's straightforward to put a lot of loosely coupled compute units on a single chip, or at least a single box. The question is, then what?
- ILLIAC 4 (64-cpu mainframe, 1970s): "A matrix multiply is a master's thesis, a matrix inversion is a PhD thesis, and a compiler may be beyond the power of the human mind".
- Connection Machine. (SIMD in lockstep, which just wasn't that useful.)
- NCube (I tried using one of those, 64 CPUs in an array, each with local memory, message passing hardware. It was donated to Stanford because some oil company couldn't find a use for it. Someone got a chess program going, which works as a distributed search problem.
- The Cell CPU in the Playstation. (Not enough memory per CPU to do much locally, and slow access to main memory. Tied up the entire staff of Sony Computer Entertainment America for years trying to figure out a way to make it useful.)
- Itanium. (I went to a talk once by the compiler group from HP. Optimal instruction ordering for the thing seemed to be NP-hard, without easy approximate solutions.)
Those are just the major ones that made it to production.
But then came GPUs, which do useful things with a lot of loosely coupled compute units on a single chip. GPUs have turned out to be useful for a reasonable range of compute-heavy tasks other than graphics. They're good for neural nets, which are a simple inner loop with massive parallelism and not too much data sharing. So there may now be a market in this space for architectures which failed at "general purpose computing".
- notacoward 5y agoAlso Multiflow and more recently Convey. http://www.multiflowthebook.com/ http://www.multiflowthebook.com/ https://www.dmagazine.com/publications/d-ceo/2012/december/convey-computer-old-guard-tackles-big-data/ https://www.dmagazine.com/publications/d-ceo/2012/december/c... Multiflow definitely reached production. I even worked at a company that contracted to write some software for them (though I personally wasn't involved). They were not a total flop, but obviously not a stellar long-term success either. I'm not sure if Convey actually reached production, but their approach seems much more similar to what Ascenium is trying to do.
- incrudible 5y ago> The Cell CPU in the Playstation. (Not enough memory per CPU to do much locally, and slow access to main memory. Tied up the entire staff of Sony Computer Entertainment America for years trying to figure out a way to make it useful.) At least towards EOL, developers did figure out what to use it for, like using the massive readback performance on the SRAM for tiled deferred shading: https://de.slideshare.net/DICEStudio/spubased-deferred-shading-in-battlefield-3-for-playstation-3 https://de.slideshare.net/DICEStudio/spubased-deferred-shadi... Good luck teaching that trick to your magic compiler.
- deleted 5y ago[deleted]