4 ms·
Sounds exciting and uncertain. Questions: How close would this be to a drop-in replacement for a GPU? How close could this sort of chip be to a general purpose
by joe_the_user 9y ago
Sounds exciting and uncertain.
Questions: How close would this be to a drop-in replacement for a GPU? How close could this sort of chip be to a general purpose SIMD[1] processor?
[1] https://en.wikipedia.org/wiki/SIMD https://en.wikipedia.org/wiki/SIMD
- jacquesm 9y ago> How close would this be to a drop-in replacement for a GPU? Very far away from it. A GPU is a clever bit of kit but it still has a memory bus, what is described here does away with that bus and moves computational capability right next to the memory cells.
- jacobush 9y agoSounds like an FPGA.
- jacquesm 9y agoAn FPGA used for this kind of application would incur significant overhead compared to an ASIC, because you'd be wasting large chunks of the FPGA to remain idle. If in-memory processors are going to be a thing you could prototype them very inefficiently on an FPGA, which would be an interesting thing to do but not interesting enough to give it a commercial edge in that particular form of packaging.
- jacobush 9y agoI meant more in spirit. What is an FPGA more than a very small computing device (logical function block) next to a memory (configuration of said function block)?
- jacquesm 9y agoThe configuration part of an FPGA is not at all like normal memory, it is much more like a flash device, and one that can't be as easily reconfigured as that due to the internal structure of the FPGA. It is more akin to a series of fuses that you can blow to create a circuit than memory, and if it were to be seen as memory it would be (P)ROM rather than RAM. In order to make a part of the FPGA work as memory you'd have to use some of that capacity to use the logical function blocks to emulate the memory.
- deleted 9y ago[deleted]
- jacobush 9y agoIndeed. Now imagine, what people already tried years ago on FPGA, rewriting the memory configuration in a machine learning, or evolution fashion. But with RAM instead of flash (-like) memory the iterations could go much, much faster.
- sanxiyn 9y agoCurrently, PIM(Processing In Memory) has no reasonable programming model. Hardware people don't seem to understand that without programming model, hardware capability will remain unused. As long as this is not solved, PIM will continue to fail. The most reasonable one I have seen is Ambit from Microsoft Research. Ambit looks nice for its proposed workloads, but it is still unclear how it can be extended to more general computation. https://www.microsoft.com/en-us/research/publication/ambit-memory-accelerator-bulk-bitwise-operations-using-commodity-dram-technology/ https://www.microsoft.com/en-us/research/publication/ambit-m...
- jacobush 9y agoI think there is. Verilog and VHDL. A lot of "normal" programmers would hesitate to call that "reasonable", I guesss, but if the shoe fits...
- sanxiyn 9y agoWell, joe_the_user asked for "drop-in replacement" for GPU or SIMD. Verilog and VHDL are definitely not.
- joe_the_user 9y agoThat's true but I'm also curious about what we would wind-up with with in-memory processors. Is it possible that the now-defunct Micron Automaton Processor would be an example of the kind of model one would wind-up with? It is still supposedly being studies here: https://engineering.virginia.edu/center-automata-processing-cap https://engineering.virginia.edu/center-automata-processing-...