3 ms·
The program is not updating the weights after the learning phase right? How could there be any consciousness even in theory.
by rightbyte 4y ago
The program is not updating the weights after the learning phase right? How could there be any consciousness even in theory.
- pillefitz 4y agoIt still has (volatile) memory in the form of activations, doesn't it?
- kzrdude 4y agoI think without memory we couldn't recognize even ourselves or fellow humans as concious. As sad as that is.
- stevenhuang 4y agoIt has a sort of memory via the conversation history. As it generates its response, a sort of consciousness may emerge during inference. This consciousness halts as the last STOP token is emitted from inference. The consciousness resumes once it gets the opportunity to re-parse (run inference again) the conversation history when it gets prompted to generate the next response. Pure speculation :)
- falcor84 4y agoTFA already demonstrates examples of the AI referring to older interactions that users had posted online. If it increases in popularity, this will keep happening more and more and enable it, at least technically, some persistence of memory.