2 ms·
Yes, 4 trillion on a single wafer. Apparently they're designed to be full wafer-sized. It's not a single multi-trillion monolithic core. 4 trillion tra
by sillywalk 3y ago
Yes, 4 trillion on a single wafer. Apparently they're designed to be full wafer-sized. It's not a single multi-trillion monolithic core.
4 trillion transistors
900,000 AI cores
125 petaflops of peak AI performance
44GB on-chip SRAM
5nm TSMC process
External memory: 1.5TB, 12TB, or 1.2PB
Trains AI models up to 24 trillion parameters
Cluster size of up to 2048 CS-3 systems
https://www.cerebras.net/press-release/cerebras-announces-third-generation-wafer-scale-engine https://www.cerebras.net/press-release/cerebras-announces-th...