That's an interesting thought. How would a single NN instance behave if it was turned on continuously, constantly responding to inputs and adjusting its model t

That's an interesting thought. How would a single NN instance behave if it was turned on continuously, constantly responding to inputs and adjusting its model to those inputs continuously? Regardless, I don't think we're going to get something that looks "intelligent", because these models lack agency... the drive or directive to do things for their own benefit, mostly because that would be a useless for us. I think we regard intelligence as another being ("instance" if you will) acting in its own self-interest, and we think it's clever when it does it in a way we wouldn't have predicted.