Those are material science and physical limitations. Number of parameters in a neural network is not really limited that way, doing useful compute with it is a

Those are material science and physical limitations. Number of parameters in a neural network is not really limited that way, doing useful compute with it is a different matter