4 ms·
> These are still roughly 10 times more expensive than they should be because of their memory architecture. I'd vote to drop the idea of busses to external memo
by dragontamer 5y ago
> These are still roughly 10 times more expensive than they should be because of their memory architecture. I'd vote to drop the idea of busses to external memories and switch to local memories, then have the cores self-organize by using web metaphors like content-addressable memory (CAM) to handle caching. Basically get rid of all of the cache coherence hardware and treat each core-memory as its own computer. The hardware that wasn't scalable could go to hardware-accelerated hashing for the CAM.
If you want "many cores" and "get rid of cache-coherence hardware", its called a GPU.
Yes, a lot of those "cores" are SIMD-lanes, at least by NVidia / AMD naming conventions. But GPU SIMD-lanes have memory-fetching hardware that operates per-lane, so you approximate the effects of a many-many core computer.
-------
Japanese companies are experimenting with more CPUs though. PEZY "villages" are all proper CPUs IIRC, but this architecture isn't very popular outside of Japan. In terms of the global market, your best bet is in fact a GPU.
The Fujitsu ARM supercomputer was also ARM-based + HBM2. But once again, that's a specific Japanese supercomputer and not very popular outside of Japan. It is available though.
- freemint 5y agoJapanese Companies such as NEC are also selling Vector Computers such as the NEC SX-Aurora TSUBASA Plugin cards.
- dragontamer 5y agoYeah. I like to read the whitepapers from these Japanese companies but I have no practical experience with them. The TSUBASA cards look like they're somewhere in between CPU and GPU. But its hard for me to understand it without actually playing with them directly.
- freemint 5y agoThe German weather service uses them extensively so they are probably really decent with PDEs.