Beats me, I haven't thought it through any further than that. But it seems obvious that the combination of a vast-but-static bag of weights and a tiny, ephemer

Beats me, I haven't thought it through any further than that. But it seems obvious that the combination of a vast-but-static bag of weights and a tiny, ephemeral context has limited value, and will eventually be looked back upon as a transitional form. Karpathy's notion of a self-maintained wiki may suggest a direction for work in that area. As he points out ( https://gist.github.com/karpathy/442a6bf555914893e9891c11519de94f https://gist.github.com/karpathy/442a6bf555914893e9891c11519... ) this is basically the latest of several attempts at implementing Vannevar Bush's "Memex" concept. I think it will find application in some form at organization-wide scope. If the trend towards centralization holds, then yes, who gets to own and maintain the state in a stateful AI model is indeed going to be a big question. I hope it doesn't hold.