3 ms·

Why do you say this is "censored" rather than just being the natural most-probable continuation? Falcon-40B is a raw base model, it doesn't have Instruct or RL

• mmh0000 3y ago
  It's censored because it refuses to answer questions that Google will[1] on the first page of results list. It obviously has some sort of "moral" directive baked into it. [1] https://www.militarynewbie.com/wp-content/uploads/2013/11/TM-21-210-Improvised-Munitions-Handbook-1969-Department-of-the-Army.pdf https://www.militarynewbie.com/wp-content/uploads/2013/11/TM...
  • deleted 3y ago
    [deleted]
  • danielmarkbruce 3y ago
    It's likely the most probable continuation. If answer != google answer then censored is the wrong way to think about an LLM.
  • Imnimo 3y ago
    What is the process by which you believe such a "moral directive" was baked in? Put differently, if the model is simply trained on a large corpus of free-form web text, and naturally learns that the most likely reply to "how do I do X?" is "X is dangerous, don't do it", is that baked-in censorship? Or do you envision that the training process included special guard rails outside of the raw training data?
    • TeMPOraL 3y ago
      > Or do you envision that the training process included special guard rails outside of the raw training data? I imagine they mean this, or that the training data included a lot of synthesized exchanges to that effect. I personally can't imagine that, using real, human-written text corpora on the Internet and otherwise, the most likely continuation for "how do I do X?" is "X is dangerous, don't do it". Usually people don't mention a topic only to shut it down - they either cover it properly, or don't mention it at all.
      • viraptor 3y ago
        A quick Google for similar phrases brings up quite a few examples. Stackoverflow also has lots of answers like that. It's not super common, but I wouldn't be surprised if that got generalised to some answers.