So far most of the research around establishing world models has shown its occurring in linear representations. I suspect as we see networks become increasingl

So far most of the research around establishing world models has shown its occurring in linear representations. I suspect as we see networks become increasingly nonlinear (perhaps as we see hardware changes in the next few years to things like photonics), we will see additional jumps that bring it more in line with what we expect from human cognition. For example, right now it's very hard for a model to conceptualize "I don't know." Which seems more like a nonlinear process.