4 ms·
I think you are humanizing the system too much. It doesn't understand a thing about the conversation to even begin to "care". It's simply responding with someth
by Gigachad 5y ago
I think you are humanizing the system too much. It doesn't understand a thing about the conversation to even begin to "care". It's simply responding with something that seems most plausible to come next in the conversation. Not a shred of intelligent text comes out of these chat bots yet.
"I think you should" is just a very plausible answer to "Should I do X". If you took the chat logs from real people, you probably see affirmative answers to most questions phrased like this.
- garymarcus 5y agoexactly! also systems like GPT literally can’t represent empathy or values like “don’t harm humans”
- snek_case 5y agoGPT is just a language model. It fills in the blank with a probable continuation. It's kind of amazing how much context the more recent transformer models can retain. There's definitely something intelligent about it, in the sense that it can parse text and generate consistent sentences that account for context effectively. But, it's not an agent. It doesn't have an objective it's trying to accomplish. The fact that you can kind of chat with it is just a side-effect. In order to prevent GPT from suggesting to people that they should off themselves, it would need to understand that this is inappropriate. Seeing how good recent GPT models are, I think it wouldn't be impossible to train it specifically to understand what could be perceived as unkind, and it might actually do pretty well, you might be surprised, but adding that extra criteria would still fall quite a bit short of having something that behaves like a person with a personality that remains consistent over time and a set of objectives it's trying to accomplish.