3 ms·

Thanks. So what does the output look like without rlhf?

• simonw 4y ago
  This comment has a useful comparison between the two: https://news.ycombinator.com/item?id=35140447 https://news.ycombinator.com/item?id=35140447
• valine 4y ago
  It can look like anything. Sometimes it will answer your questions, other times it will continue the question like its the one asking. I've also seen it randomly output footers and copyright like it just got to the end of a webpage. Its makes sense when you think about how the training data is random text on the internet. Sometimes the most likely next token is the end of a webpage after an unanswered question.