For large models, the bottlenecks are memory bandwidth, network, and power consumption by the DAC/ADC arrays It’s never come even close to penciling out in pra

For large models, the bottlenecks are memory bandwidth, network, and power consumption by the DAC/ADC arrays It’s never come even close to penciling out in practice. For small models there are people working on this implemented in flash memory eg Mythic.