4 ms·
My understanding of these AIs is that they are idle - nothing happening in the program's loop except waiting for input - unless being prompted with some input (
by Cannabat 4y ago
My understanding of these AIs is that they are idle - nothing happening in the program's loop except waiting for input - unless being prompted with some input (e.g. a conversation). The AIs are purely reactive.
Does sentience require self-reflection? How can it self-reflect if it cannot prompt itself?
Am I wrong about these language models and other AIs being purely reactive?
Perhaps humans are purely reactive.
- upwardbound 4y agoI think the model does have short-term memory, but not long-term memory, if I'm understanding it correctly. From https://aibusiness.com/document.asp?doc_id=777540 https://aibusiness.com/document.asp?doc_id=777540 : "LaMDA2 was trained on Google’s Pathways Language Model (PaLM), which has 540 billion parameters." And then looking at the PaLM paper https://arxiv.org/pdf/2204.02311.pdf https://arxiv.org/pdf/2204.02311.pdf on page 5 we have: "PaLM uses a standard Transformer model architecture (Vaswani et al., 2017) in a decoder-only setup (i.e., each timestep can only attend to itself and past timesteps)"