4 ms·
What caught my eye: "In-memory computing (a.k.a processing-in-memory or compute in memory) refers to having the processing or computation inside the memory (su
by scrubs 4y ago
What caught my eye:
"In-memory computing (a.k.a processing-in-memory or compute in memory) refers to having the processing or computation inside the memory (such as the RAM). Some time ago, before this was done at the chip level, it has been demonstrated that by distributing data across multiple RAM storage units and combining that parallel processing, the performance results in cases like investment banking was 100 times faster. So while in-memory/near-memory computing has been around for a long time, and has gotten another boost from AI designs, only recently chipmakers have started to demonstrate some successes with this approach.
In 2021, Samsung’s memory business unit introduced the processing-in-memory (PIM) technology with integrated AI cores inside HBM memory. In a speech-recognition test using the Xilinx Virtex Ultrascale and an (Alveo) AI accelerator, the PIM technology was able to achieve a 2.5X performance increase and a 62% reduction of energy. Other memory chip makers like SK Hynix and Micron Technology also are looking at this approach.
In the domain of in-memory computation, a breakthrough announcement recently came from the international research team headed by Weier Wan, a recent Ph.D. graduate in the lab of Philip Wong at Stanford University, who worked on this idea while at UC San Diego. Other Ph.D. graduates at UC San Diego who made major contributions to this research are now running their own labs at Notre Dame University and the University of Pittsburgh."
As I referenced in another post recently on the question of what a modern O/S would look like, moving ram closer to compute in H/W is probably as good as basis as any on which to base a modern O/S i.e. better O/S through better HW.
- c0balt 4y agoMaybe, one day in the future, we can run DOOM on our RAM. Or the RAM gets comprimised either way this sounds very promising.