4 ms·
I'm glad it is not just me who thinks I need to "thank" chatGPT or encourage it, e.g.: "Great, now do .... " "Great, now do ... ".
by ChancyChance 4y ago
I'm glad it is not just me who thinks I need to "thank" chatGPT or encourage it, e.g.: "Great, now do .... " "Great, now do ... ".
- aiappreciator 4y agoIts not 'thanking', its positive signal that GPT's previous outputs were correct, so it should continue doing whatever it was doing. If you say no/bad etc, then GPT will try other approaches.
- csmpltn 4y ago> "its positive signal that GPT's previous outputs were correct" Is that somehow baked into the algorithms? Are positive words of encouragement interpreted as "positive signals" by the inference pipeline? Or do they somehow influence the attention mechanism? Because otherwise, you're just rationalizing completely random and unpredicted behavior.
- gitgud 4y ago> Is that somehow baked into the algorithms? OpenAI’s API is stateless, which means you need to send the entire conversation thread in each request. So when you send a response like “perfect, now do…”, you’re reinforcing the language model that the conversation history is on the right track.
- ChancyChance 4y agoThat's literally what I said: those words are "encouraging" it.
- deleted 4y ago[deleted]
- cwkoss 4y agoOpenAI surely retains conversation logs. When super intelligent AI gains power, I want it to know I've been a good boy.
- quchen 4y agoPascal’s Wager, AI edition? :-) https://en.wikipedia.org/wiki/Pascal%27s_wager https://en.wikipedia.org/wiki/Pascal%27s_wager
- terramex 4y agoRoko's basilisk: https://en.wikipedia.org/wiki/Roko%27s_basilisk https://en.wikipedia.org/wiki/Roko%27s_basilisk
- ChancyChance 4y agoThat is the 180-degree opposite of Occam's Razor.
- cwkoss 4y agoGod is not inevitable