3 ms·

I think the main issue is in a way that gpt like models generate output. eg. when you write some serious document or write code you don't just start from the fi

I think the main issue is in a way that gpt like models generate output. eg. when you write some serious document or write code you don't just start from the first line and write the whole application in one go (line by line) you write the basic "hello world" like app, and then modify, modify, modify and modify until you have something advanced enough. i think that's the reason ReAct and other ai improving methods are so effective, because that add ai space to "think" in some way. I think breakthrough would be a way that would allow ai to have its own inner voice, maybe some fine tuning and giving ai some scratchpad memory (hidden) would be enough?

sgregnt 3y ago
I think that to give an AI an inner voice we need to train a set of AI, with shared weights but ability to cooperate through low bandwidth channels. This should mimic human language , to communicate the AI will need to conceptualize its internal thinking, and thus also be able to communicate with itself, i.e., be able to do internal reasoning.
- Szpadel 3y ago
  This could allow use some training methods similar to alpha go zero. I'm thinking if training ai to output edits instead of next token would be enough. Training would be similar to currently used: just provide some sentences with missing words and asks model to edit those placeholders. Then hopefully ai would learn how to iteratively built response until it's good enough. This could allow ai to spot it's errors in the middle of output and start refactoring what it already generated and add some notes (thoughts) that it could later remove as scratchpad. It could iterate on its context much more so it could have chance to "think" about it
- arc619 3y ago
  What you describe sounds like experiments with "generative agents". Check out https://arxiv.org/abs/2304.03442 https://arxiv.org/abs/2304.03442
tornato7 3y ago
Having the AI tell you it's thought process is very similar to giving it an 'inner voice' Just give it a question with a half dozen logical steps and tell it to answer in one word. It can't. But tell it to write out the thought process and it will get to the correct answer. Similarly, you can ask it to outline some code and then begin filling it in.

sgregnt 3y ago

I think that to give an AI an inner voice we need to train a set of AI, with shared weights but ability to cooperate through low bandwidth channels. This should mimic human language , to communicate the AI will need to conceptualize its internal thinking, and thus also be able to communicate with itself, i.e., be able to do internal reasoning.

Szpadel 3y ago
This could allow use some training methods similar to alpha go zero. I'm thinking if training ai to output edits instead of next token would be enough. Training would be similar to currently used: just provide some sentences with missing words and asks model to edit those placeholders. Then hopefully ai would learn how to iteratively built response until it's good enough. This could allow ai to spot it's errors in the middle of output and start refactoring what it already generated and add some notes (thoughts) that it could later remove as scratchpad. It could iterate on its context much more so it could have chance to "think" about it
arc619 3y ago
What you describe sounds like experiments with "generative agents". Check out https://arxiv.org/abs/2304.03442 https://arxiv.org/abs/2304.03442

tornato7 3y ago

Having the AI tell you it's thought process is very similar to giving it an 'inner voice' Just give it a question with a half dozen logical steps and tell it to answer in one word. It can't. But tell it to write out the thought process and it will get to the correct answer. Similarly, you can ask it to outline some code and then begin filling it in.