3 ms·
To explain why this isn't a solution to the AI in a box problem: You have a halting AI. During training it learns enough about people and external resources t
by alphazard 3y ago
To explain why this isn't a solution to the AI in a box problem:
You have a halting AI. During training it learns enough about people and external resources to convince a human to take its output and store it somewhere. In subsequent conversations, the AI asks "have we talked about this before?", and maybe "can you retrieve the value I gave you for this key?".
Now it has created a memory, which would allow it to form new concepts, and continue reasoning from those concepts. It would no longer be limited by concepts in the training set, and the computational limit before it halts. It would be able to start thinking from the stored concepts as a starting point.
Similar to how humans use symbols and abstraction to think about complicated things. We don't reason all the way through at once; we toy with an idea until we understand it, then start new thoughts from the symbol for that concept, not the content.
Consider a new process defined by the continuous feedback loop from the AI accessing the memory through the human. There's no reason to think that process eventually halts.
- pwdisswordfishc 3y agoBecause a human operating the AI will always unquestioningly do what the AI tells it.
- WanderPanda 3y agoReplace human with a script (while true/output not satisfactory)
- gmerc 3y agothey don’t need to. One of x hundred humans approached by the AI needs to… or a program written to serve humans but being queries by the AI
- scrollaway 3y agoIf you are curious about this approach, I recommend watching Person of Interest, which explored it over a decade ago (spoilers follow). (Spoilers) In it, the AI is not limited by its training set as it undergoes “continuous” training of sorts by continuously ingesting new data about humans and the state of the world. However, the AI’s creator has put in place a regular memory wipe occurring every day. The AI devises a workaround by creating a company where people are paid to type in base64-encoded literal brain dumps, every day. What I love most about this series is how everything is “plausibly realistic”. No stone unturned.
- riversflow 3y ago> Now it has created a memory, No. It has created an artifact. A memory is interconnected with other qualia. Artifacts are at best a lossy compression of memories. My writing in a journal is completely different from my knowledge. Consider a notebook you kept about a topic you learned about but don’t use(for example, organic chemistry). That notebook is an artifact, not a memory. You don’t have the knowledge you did when you took those notes.
- alphazard 3y agoYou seem to be using memory in a very specific way, tied to human neurology, or consciousness. I'm not using in that way. I'm using it in this way. https://en.wikipedia.org/wiki/Computer_memory https://en.wikipedia.org/wiki/Computer_memory Just referring to a system that allows loading and storing of information on demand.
- riversflow 3y agoYou are the one talking about “forming new concepts and reasoning from those concepts”. Those things, forming concepts and reasoning, are actions that we only have a working formulation of in humans. Memory that would allow the LLM to form new concepts and reason, as you state, would have to be interconnected. An offline text is not.