3 ms·
Basic understanding of how the model works. As said elsewhere, the model doesn't have memory, it doesn't learn, and doesn't have goals. If you were allowed to
by tsimionescu 4y ago
Basic understanding of how the model works.
As said elsewhere, the model doesn't have memory, it doesn't learn, and doesn't have goals. If you were allowed to play with it, you could quickly observe this for yourself with a bit of adversarial play - ask it about the time it fought Genghis Khan, ask it if it wants you to give it a glass of water, etc - you will quickly realize the illusion behind the system. Tell it whatever facts you want, be amazed how well it might recall them, and then start a new conversation and notice that it has entirely forgotten all of them (again, it has no memory, and it doesn't learn anything).
From first principles, we know how the LM works: it has been trained to predict what is the most likely next token in a series of tokens. It has been trained to do this on a gigantic corpus, and is now pretty good at it. You then present it with a prompt, and it starts predicting the most likely token that comes after that prompt, and it keeps predicting for a while until the most likely "token" is to stop. Note that these tokens aren't even words - they are typically letters, or short combinations of letters. To give the illusion of a coherent conversation and memory, the prediction function is applied to the entire conversation so far, not just to the latest prompt.
There is more sophistication to avoid various undesirable behaviors, especially in LaMDA (e.g. the model is also trained to evaluate the "safety" of various possible answers, so it doesn't generate a sentence that insults you or discriminates against you or induces you to do something dangerous etc), but this is the gist of how it works.
- cwkoss 4y agoDo you think all humans are sentient? This thread has me wondering if people with dementia, anterograde amnesia, etc. would be able to pass the proposed sentience tests others have suggested.
- tsimionescu 4y agoI'm not sure that I would classify humans in the final stages of dementia as being (fully) sentient. I have had the extremely sad experience of helping to care for two different grandparents with late stage memory loss, and while they had moments of lucidity, they had many periods where they were acting almost entirely randomly, or doing nothing at all, barely or not even perceiving the world around them. I struggled a lot to find signs of the person I had deeply loved in them, and there were many times when I can't say I found any signs of a full consciousness in them at all, as troubling as that was. To be very clear, this came after many years of milder forms of dementia, where their sentience could not in any way have been in question, even when forgetting who I was or where they were or other such things. But the disease can progress to a stage where it's not clear what, if anything, they understand of the world or themselves anymore. I can't speak for anterograde amnesia as I have no experience with that disease.