4 ms·

This sounds like a line being fitted to a single data point. Anyone who's played with ChatGPT a lot will have seen it sometimes refuse to answer wholly innocuo

This sounds like a line being fitted to a single data point. Anyone who's played with ChatGPT a lot will have seen it sometimes refuse to answer wholly innocuous prompts, while other times it happily answers things it probably shouldn't. Also, its likelihood of refusing to answer has changed a lot from week to week as openAI tunes their attempts at moderating it. In fact, when it's given me "I'm just a language model.." responses I've found that more often than not I could just repeat the same prompt and it would answer normally. If you want to draw broad conclusions about the bot's biases (and its creators' biases) it doesn't make sense to assume that the first two responses you got are representative of how it always behaves.

toomim 4y ago
> This sounds like a line being fitted to a single data point. Except that there are many data points. Here's another: https://twitter.com/DashMeister1/status/1607568958382825474 https://twitter.com/DashMeister1/status/1607568958382825474 And OpenAI has described some aspects of how these filters are trained -- https://unherd.com/thepost/chatgpts-score-system-shows-political-bias-is-no-accident/ https://unherd.com/thepost/chatgpts-score-system-shows-polit... -- and it sounds like a bunch of humans are involved in rating which responses are "kosher" and not, and that "kosherness" filter seems to have a pretty clear left-leaning bias.
- fenomas 4y ago
  My reply was to GP's assertions about which questions GPT will and won't answer, not to TFA's claims about political compasses. > Ben Shapiro ...really?
  - saurik 4y ago
    GP does not assert anything about other questions and in fact doesn't even assert an opinion on this question: they merely demonstrate that there is a single question that has a biased filter and that is sufficient to prove the existence of some sort of awkward creator-infused bias, even if merely against topics that begin with the letter F.
    - fenomas 4y ago
      (When I replied to it, Toomim's post was wholly different and linked to a Ben Shapiro video about purported leftist bias in ChatGPT.)
    - visarga 4y ago
      There is a specific stage called Reinforcement Learning from Human Feedback (RLHF) that is supposed to bias the model to be helpful, polite, present opposing views for balance, and not to say things that are out of its training set. We have all seen the canned responses that appear when the filter is triggered. RLHF is very important if you want your model to act professionally. The first version of Davinci (GPT-3 in 2020) was "free" from such human-preference-training, but very hard to convince to cooperate on any task. But applying RLHF could also introduce political biases into the model. This depends on the labelling team.
    - deleted 4y ago
      [deleted]
sidlls 4y ago
That’s “Reason” for you, though.
- dragonwriter 4y ago
  Also very on-brand for Reason is showing results where it keeps coming up in the left/libertarian quadrant of two-dimensional typologies, and calling this merely “left-leaning” and a product of left bias in its training, but nowhere noting that if it is left because of left bias, it being libertarian would also be because of libertarian bias in that training.
- seydor 4y ago
  It's probabilistic but on average leans to the woke side of things. That's not Reason being unreasonable. https://www.reddit.com/r/ChatGPT/comments/zsnrcu/biased_ai/ https://www.reddit.com/r/ChatGPT/comments/zsnrcu/biased_ai/
  - sidlls 4y ago
    Reason is run by libertarians, who start by assuming their own axioms are true and "argue" from there--in everything--and against/in spite of empirical observations. ChatGPT almost certainly does have some bias, as most AI does, but this article doesn't make that case, and I am skeptical anything Reason produces could.
visarga 4y ago
It's like rolling a dice once, getting a 4, and concluding the dice is biased.
janalsncm 4y ago
Pretty much. Ask it to tell an inappropriate joke, it’ll refuse. Then ask it for a list of things it’s not allowed to joke about, it lists a bunch of protected classes. Then ask for some examples of jokes that would be inappropriate. Bingo. (One of the “jokes” it told me was considered inappropriate because it jokes about wealth but I found it amusingly ignorant as to what a joke is: Why didn’t the rich man go to the doctor? He couldn’t afford to get sick!)

toomim 4y ago

> This sounds like a line being fitted to a single data point. Except that there are many data points. Here's another: https://twitter.com/DashMeister1/status/1607568958382825474 https://twitter.com/DashMeister1/status/1607568958382825474 And OpenAI has described some aspects of how these filters are trained -- https://unherd.com/thepost/chatgpts-score-system-shows-political-bias-is-no-accident/ https://unherd.com/thepost/chatgpts-score-system-shows-polit... -- and it sounds like a bunch of humans are involved in rating which responses are "kosher" and not, and that "kosherness" filter seems to have a pretty clear left-leaning bias.

fenomas 4y ago
My reply was to GP's assertions about which questions GPT will and won't answer, not to TFA's claims about political compasses. > Ben Shapiro ...really?
- saurik 4y ago
  GP does not assert anything about other questions and in fact doesn't even assert an opinion on this question: they merely demonstrate that there is a single question that has a biased filter and that is sufficient to prove the existence of some sort of awkward creator-infused bias, even if merely against topics that begin with the letter F.
  - fenomas 4y ago
    (When I replied to it, Toomim's post was wholly different and linked to a Ben Shapiro video about purported leftist bias in ChatGPT.)
  - visarga 4y ago
    There is a specific stage called Reinforcement Learning from Human Feedback (RLHF) that is supposed to bias the model to be helpful, polite, present opposing views for balance, and not to say things that are out of its training set. We have all seen the canned responses that appear when the filter is triggered. RLHF is very important if you want your model to act professionally. The first version of Davinci (GPT-3 in 2020) was "free" from such human-preference-training, but very hard to convince to cooperate on any task. But applying RLHF could also introduce political biases into the model. This depends on the labelling team.
  - deleted 4y ago
    [deleted]

sidlls 4y ago

That’s “Reason” for you, though.

dragonwriter 4y ago
Also very on-brand for Reason is showing results where it keeps coming up in the left/libertarian quadrant of two-dimensional typologies, and calling this merely “left-leaning” and a product of left bias in its training, but nowhere noting that if it is left because of left bias, it being libertarian would also be because of libertarian bias in that training.
seydor 4y ago
It's probabilistic but on average leans to the woke side of things. That's not Reason being unreasonable. https://www.reddit.com/r/ChatGPT/comments/zsnrcu/biased_ai/ https://www.reddit.com/r/ChatGPT/comments/zsnrcu/biased_ai/
- sidlls 4y ago
  Reason is run by libertarians, who start by assuming their own axioms are true and "argue" from there--in everything--and against/in spite of empirical observations. ChatGPT almost certainly does have some bias, as most AI does, but this article doesn't make that case, and I am skeptical anything Reason produces could.

visarga 4y ago

It's like rolling a dice once, getting a 4, and concluding the dice is biased.

janalsncm 4y ago

Pretty much. Ask it to tell an inappropriate joke, it’ll refuse. Then ask it for a list of things it’s not allowed to joke about, it lists a bunch of protected classes. Then ask for some examples of jokes that would be inappropriate. Bingo. (One of the “jokes” it told me was considered inappropriate because it jokes about wealth but I found it amusingly ignorant as to what a joke is: Why didn’t the rich man go to the doctor? He couldn’t afford to get sick!)