When we start building models to train and optimize other models, I would expect emergent behavior. If we did something foolish like building yhe system in suc

When we start building models to train and optimize other models, I would expect emergent behavior. If we did something foolish like building yhe system in such a way that it could write and execute code, then the emergent behavior could do things as nasty as anything else on the internet. We have also seen emergent behavior in programmable hardware [1] so I tend to be pessimistic about the limits of what such a system could do. Also it could pay human minions to interact with the physical world if needed. [1] https://www.damninteresting.com/on-the-origin-of-circuits https://www.damninteresting.com/on-the-origin-of-circuits