Exactly, this is a component of what we're planning. We'd need agents constantly updating their interfaces, locations, and all sensor data simultaneously. Also

Exactly, this is a component of what we're planning. We'd need agents constantly updating their interfaces, locations, and all sensor data simultaneously. Also building some corpus of ontologies for these systems needs to exist -- and we're hoping to make it a community effort (a la freebase), as well as the recipes for actions between disparate systems or at least some reasonable way to address/connect the commonalities between interfaces. Next will be developing artificial intuition, being able to connect interfaces in new and thoughtful ways to produce some interesting/undiscovered/unsupervised outcome.