3 ms·

Well, no - it's interpreting it as an instruction a chatbot AI would receive. From an almighty and omniscient 'system'. We're training our AI on dystopian sci-

• cloudking 3y ago
  It has to be prompted that it's an AI chatbot first, so its essentially pretending to be a human that is pretending to be an AI chatbot. Back to the point, it interprets instruction as a human would. If you look under the hood of these chat systems they have to be primed with a system prompt that starts like "You are an AI assistant", "You are a helpful chat bot" etc. They don't just start responding like an AI chatbot without us telling them to.
  • jameshart 3y ago
    What is the “it” that is doing the pretending?
    • cloudking 3y ago
      The trained model, it takes your input and runs it through some complex math (tuned by the weights) and gives an output. Not much mystery to it.
• avereveard 3y ago
  It doesn't seem there's such a nefarious intent. If you think at most literature, two characters interacting will address each other in the second person. If you think at recipes, most often instructions are addressed to the reader as you. There's plenty of samples of instructions being given in the second person, and there's plenty samples in literature where using the second person elicits a second person follow-up, which is great for chat model because even if they are still just completing sentences with the most likely token, it gives the illusion of a conversation.