For some sense of how far out/close 1 trillion transistors in one GPU is: NVIDIA just announced Blackwell which gets to 208bn transistors on a chip by stitchin

For some sense of how far out/close 1 trillion transistors in one GPU is: NVIDIA just announced Blackwell which gets to 208bn transistors on a chip by stitching two dies together into a single GPU. https://www.nvidia.com/en-us/data-center/technologies/blackwell-architecture/ https://www.nvidia.com/en-us/data-center/technologies/blackw... They’re sticking two of them in a board with a Grace CPU in between, then linking 36 of those those boards together in racks with NVLink switches that offer “130TB/s of GPU bandwidth in one 72-GPU NVLink domain”. In terms of marketing, NVidia calls one of those racks a GB200 NVL72 “super GPU”. So on one level NVIDIA would say they already have a GPU with ‘trillions’ of transistors.