I'm not sure how SOTA it is but the sentence about connecting DRAM differently reminded me of Cerebras' scalable MemoryX and its "weight streaming" architecture

I'm not sure how SOTA it is but the sentence about connecting DRAM differently reminded me of Cerebras' scalable MemoryX and its "weight streaming" architecture to their custom ASIC. You may find it interesting. [1]: https://cerebras.ai/press-release/cerebras-systems-announces-worlds-first-brain-scale-artificial-intelligence-solution/ https://cerebras.ai/press-release/cerebras-systems-announces... [2]: https://cerebras.ai/chip/announcing-the-cerebras-architecture-for-extreme-scale-ai/ https://cerebras.ai/chip/announcing-the-cerebras-architectur...