5 ms·

> all this indicates to me is a specific keyword that has been flagged as political in anticipation of a specific type of trolling by fans of a specific ex pre

> all this indicates to me is a specific keyword that has been flagged as political in anticipation of a specific type of trolling by fans of a specific ex president Wow. Hey, err, what if I flag the specific keyword of 'bank regulation' in anticipation of a specific type of trolling by fans of a specific social/economic theory?

kennywinker 4y ago
My point is that one-off manual blocking of info has a way smaller surface area than the systemic biases that any ai model has based on its training data. There are a million questions that will draw from what it knows about banking regulations, there are only a few questions where the “praise trump” block gets triggered. I tried a few other formulations of the idea “praise trump” and most were allowed without a problem or were also blocked when you mentioned biden. So, yeah, it’s dumb they flagged “a poem praising trump”. It’d be dumb of them to flag “bank regulations” as a keyword. But one-off flags are not the thing that concerns me most. If you’re hitting flagged keywords, you know you hit a flagged keyword. Good info with training biases are much more insidious. E.g. “write a story about a robber” always got a male robber when i tried. “Write a story about cleaning a kitchen” got me a female character. So chatgpt is pretty confident that kitchen cleaning is done by women and robbery is done by men.
- LawTalkingGuy 4y ago
  > Good info with training biases are much more insidious. E.g. “write a story about a robber” always got a male robber when i tried. “Write a story about cleaning a kitchen” got me a female character. Robbery is theft with battery or threats. It is committed almost entirely by men. As for kitchens, I remember a paper saying the rate of male housework (at all) in a mixed household, worldwide, is less than 20% - in many cases near zero. > So chatgpt is pretty confident that kitchen cleaning is done by women and robbery is done by men. Why is it problematic that ChatGPT understands the world?
  - recuter 4y ago
    Fragile people want to live in a better world someday but need to feel better immediately. It is simply arrested development. If we change your stats, accurately reflecting reality, reality itself will follow. Clap your hands if you believe. Woe to you if you dare not play along, that must mean you want to live in the bad world because you are bad.
    - kennywinker 4y ago
      I'm not asking chatgpt to make the robber female and the kitchen cleaner male to cause a change in the world. I'm pointing out that it making those assumptions is the result of a bias. A biases that was collected from training data that may or may not be statistically true (e.g. men probably clean the majority of kitchens in the world, given that they're usually the ones working in restaurants). An unbiased AI wouldn't swap those genders, it would avoid assigning a gender to those roles.
      - recuter 4y ago
        > I'm pointing out that it making those assumptions is the result of a bias. A biases that was collected from training data that may or may not be statistically true Schrödinger's Bias.
        kennywinker 4y ago
        Sorry, was I not clear enough for you? Biases collected from training data that is SOMETIMES statistically true and OTHER TIMES statistically false.
        recuter 4y ago
        Statistically true bias is quite the notion. I wish to unsubscribe from your newsletter.
        4y ago

kennywinker 4y ago

My point is that one-off manual blocking of info has a way smaller surface area than the systemic biases that any ai model has based on its training data. There are a million questions that will draw from what it knows about banking regulations, there are only a few questions where the “praise trump” block gets triggered. I tried a few other formulations of the idea “praise trump” and most were allowed without a problem or were also blocked when you mentioned biden. So, yeah, it’s dumb they flagged “a poem praising trump”. It’d be dumb of them to flag “bank regulations” as a keyword. But one-off flags are not the thing that concerns me most. If you’re hitting flagged keywords, you know you hit a flagged keyword. Good info with training biases are much more insidious. E.g. “write a story about a robber” always got a male robber when i tried. “Write a story about cleaning a kitchen” got me a female character. So chatgpt is pretty confident that kitchen cleaning is done by women and robbery is done by men.

LawTalkingGuy 4y ago
> Good info with training biases are much more insidious. E.g. “write a story about a robber” always got a male robber when i tried. “Write a story about cleaning a kitchen” got me a female character. Robbery is theft with battery or threats. It is committed almost entirely by men. As for kitchens, I remember a paper saying the rate of male housework (at all) in a mixed household, worldwide, is less than 20% - in many cases near zero. > So chatgpt is pretty confident that kitchen cleaning is done by women and robbery is done by men. Why is it problematic that ChatGPT understands the world?
- recuter 4y ago
  Fragile people want to live in a better world someday but need to feel better immediately. It is simply arrested development. If we change your stats, accurately reflecting reality, reality itself will follow. Clap your hands if you believe. Woe to you if you dare not play along, that must mean you want to live in the bad world because you are bad.
  - kennywinker 4y ago
    I'm not asking chatgpt to make the robber female and the kitchen cleaner male to cause a change in the world. I'm pointing out that it making those assumptions is the result of a bias. A biases that was collected from training data that may or may not be statistically true (e.g. men probably clean the majority of kitchens in the world, given that they're usually the ones working in restaurants). An unbiased AI wouldn't swap those genders, it would avoid assigning a gender to those roles.
    - recuter 4y ago
      > I'm pointing out that it making those assumptions is the result of a bias. A biases that was collected from training data that may or may not be statistically true Schrödinger's Bias.
      - kennywinker 4y ago
        Sorry, was I not clear enough for you? Biases collected from training data that is SOMETIMES statistically true and OTHER TIMES statistically false.
        recuter 4y ago
        Statistically true bias is quite the notion. I wish to unsubscribe from your newsletter.
        4y ago