The accelerator contains 40GB of SRAM It's cache or scratchpad memory. Keep in mind this is "on chip", most systems, including this one, have additional memory

The accelerator contains 40GB of SRAM It's cache or scratchpad memory. Keep in mind this is "on chip", most systems, including this one, have additional memory off chip in the form of DRAM sticks. edit: For comparison, the NVIDIA A100 has up to 164kB of shared memory per SM while the wafer beast has about 47kB per core if you divide it out.