You can already get a single rackmount server with over a trillion transistors. For example, the CS-2 [1] has 2.6T transistors (on a single die no less!) in 15u

You can already get a single rackmount server with over a trillion transistors. For example, the CS-2 [1] has 2.6T transistors (on a single die no less!) in 15u. If you are willing to count the transistors in your dram (dram has one transistor per bit), then you can already get over 35T transistors (32x 128GB ECC DIMMs with 1.2T transistors per DIMM) per 1RU, or over a quadrillion transistors per rack. [1] https://cerebras.net/product/ https://cerebras.net/product/