4 ms·

Chat GPT probably has been given the task before and picked up on it with some keywords.

• drdeca 4y ago
  I don’t think it is being actively trained on the current conversations? Or at least not in a continual way...?
  • rrrrrrrrrrrryan 4y ago
    Isn't it though? I thought the was the whole point of the free tier: to let people give its responses thumbs ups and thumbs downs and suggest better answers.
    • drdeca 4y ago
      Yes, I do think that is to get more training data... But my impression is that continual training is difficult, so it makes more sense to get a big chunk of it and then do a big chunk of training on that? But maybe they have done that at least once already with this new data?
      • rrrrrrrrrrrryan 4y ago
        From my understanding, they have two networks: One to generate responses (with some randomness), and another network to predict whether or not that response will get upvoted or downvoted. The human upvotes and downvotes obviously train the second network. It's possible they iterate these two networks independently, but I'm not sure.
    • kadoban 4y ago
      I don't believe that those are actively fed into the AI as feedback, instead they go to the devs to have some things to investigate and see if they can improve.