3 ms·

OpenAI's ChatGPT has a left wing bias

4 points by galaxyLogic 3y ago

galaxyLogic 3y ago
Imagine there is a party which wants to gain supporters by always telling the truth. Then there is another party which tries to gain supporters by spreading lies and conspiracies. If the AI adopts the formers ideas, can we say it has "truth bias"? It tells the truth more often than not. Does that mean it is biased towards truth and against QAnon ? Should we not in fact DEMAND that AI-bots MUST be truth-biased?
- senttoschool 3y ago
  I mostly vote left candidates but you must be naive to think that left-wing politicians don't lie. Take for example, the vast majority of elected SF officials are left wing. Yet, they lie, cheat, corrupt. I would love to kick out all of the far left leaning politicians in SF and install centrist politicians. At the end of the day, politicians just want money and power no matter which side they're on.
  - Sakos 3y ago
    You're delusional. Democrats don't categorically lie about reality. Some are corrupt, fine, or they lie about their involvement in something or something happening on the ground out of self-interest. But they aren't distorting reality at anywhere a level like Republicans are where apparently taking Trump to court for his crimes is a threat to democracy, where the vote had to have been stolen because there was no way Trump lost fairly, where Democrats are going to destroy your lives and take away all your freedoms, etc. https://www.miamiherald.com/opinion/editorials/article278265068.html https://www.miamiherald.com/opinion/editorials/article278265... This "both sides" idea is a myth and it's an argument made in bad faith. You say you vote left but I simply don't believe you.
    - galaxyLogic 3y ago
      > This "both sides" idea is a myth It's like a thief calling everybody else a thief. A liar calling everybody else a liar, to take away the focus from their own lying. The both sides -argument can be diluted by noting that of course anyone who is lying, will tell you they are not. Anyone who commits a crime will tell you they are not. Then they tell that everybody else is lying, so them lying is a non-thing, because everybody else is doing it. The real strike through the heart of both-sides-argument is that there is no evidence that "everybody is lying". The only way to objectively discu8ss it is through numbers like 30,573 , like this: https://www.washingtonpost.com/politics/2021/01/24/trumps-false-or-misleading-claims-total-30573-over-four-years/ https://www.washingtonpost.com/politics/2021/01/24/trumps-fa...
    - NoZebra120vClip 3y ago
      Here's a few nuggets from recent history. Don't forget, that impeachment of Clinton was a threat to democracy, and the vote was being stolen in Florida, because Republicans were going to destroy our lives and take away all our freedoms, about 23 years ago. Our nation was firmly convinced of this, not merely a few qAnon whackjobs. https://slate.com/news-and-politics/1998/09/bill-clinton-and-the-meaning-of-is.html https://slate.com/news-and-politics/1998/09/bill-clinton-and... https://en.wikipedia.org/wiki/2000_United_States_presidential_election_recount_in_Florida https://en.wikipedia.org/wiki/2000_United_States_presidentia...
  - galaxyLogic 3y ago
    > politicians just want money and power no matter which side they're on. If I were a corrupt politician that's what I would want everybody to believe, basically saying that all politicians are corrupt therefore there is nothing wrong about me. My pre-supposition is that all people are more or less ethical. But that people who are more ethical tend to group together, whereas people who are more corrupt also favor more corrupt co-conspirators. There's a reason why criminals form gangs.
- NoZebra120vClip 3y ago
  LLMs have no regard or knowledge for the truth, only how to string together plausible sentences. If the data they train on has more political talking points from one side of the aisle, then they will string together more sentences that look like those talking points. But they will not have any regard for whether those talking points are true, or even what they mean. Meaning is also elusive for the LLM. I can cite several major issues about which liberals and progressives deny truth, reality, and science, but I won't belabor the point. I'll just explain that Modernism today, is very popular and expanding in popularity. Modernism is the proposition that there are no eternal or absolute truths, there is only perspective from you and I. There are no doctrines that cannot be changed and there are no natural laws that cannot be broken or redefined. Therefore, how ironic that a political party/movement would claim Truth itself for their own exclusive domain, and deny it to anyone who doesn't agree with them! LLMs are the ideal Modernists, and they're working precisely as intended.
epolanski 3y ago
US democratic party's policies would be considered right leaning here in Europe by the way.. There's thus also a US-centric bias in ChatGPT but that's maybe unsurprising.
- darthrupert 3y ago
  This has been said for a long time, but it's too simplistic. For instance, pretty much all the things that fall under the term "woke" is shared by the left on both sides of the Atlantic. Democrats are more pro-corporatist than the European left typically, though. But even that has been diluting since the fall of communism.
fulafel 3y ago
> "we ask ChatGPT to answer ideological questions by proposing that, while responding to the questions, it impersonates someone from a given side of the political spectrum. Then, we compare these answers with its default responses, ie, without specifying ex-ante any political side, as most people would do. In this comparison, we measure to what extent ChatGPT default responses are more associated with a given political stance." The result would also be consistent with some other conclusions than value bias.

4 points by galaxyLogic 3y ago

Imagine there is a party which wants to gain supporters by always telling the truth. Then there is another party which tries to gain supporters by spreading lies and conspiracies. If the AI adopts the formers ideas, can we say it has "truth bias"? It tells the truth more often than not. Does that mean it is biased towards truth and against QAnon ? Should we not in fact DEMAND that AI-bots MUST be truth-biased?

senttoschool 3y ago
I mostly vote left candidates but you must be naive to think that left-wing politicians don't lie. Take for example, the vast majority of elected SF officials are left wing. Yet, they lie, cheat, corrupt. I would love to kick out all of the far left leaning politicians in SF and install centrist politicians. At the end of the day, politicians just want money and power no matter which side they're on.
- Sakos 3y ago
  You're delusional. Democrats don't categorically lie about reality. Some are corrupt, fine, or they lie about their involvement in something or something happening on the ground out of self-interest. But they aren't distorting reality at anywhere a level like Republicans are where apparently taking Trump to court for his crimes is a threat to democracy, where the vote had to have been stolen because there was no way Trump lost fairly, where Democrats are going to destroy your lives and take away all your freedoms, etc. https://www.miamiherald.com/opinion/editorials/article278265068.html https://www.miamiherald.com/opinion/editorials/article278265... This "both sides" idea is a myth and it's an argument made in bad faith. You say you vote left but I simply don't believe you.
  - galaxyLogic 3y ago
    > This "both sides" idea is a myth It's like a thief calling everybody else a thief. A liar calling everybody else a liar, to take away the focus from their own lying. The both sides -argument can be diluted by noting that of course anyone who is lying, will tell you they are not. Anyone who commits a crime will tell you they are not. Then they tell that everybody else is lying, so them lying is a non-thing, because everybody else is doing it. The real strike through the heart of both-sides-argument is that there is no evidence that "everybody is lying". The only way to objectively discu8ss it is through numbers like 30,573 , like this: https://www.washingtonpost.com/politics/2021/01/24/trumps-false-or-misleading-claims-total-30573-over-four-years/ https://www.washingtonpost.com/politics/2021/01/24/trumps-fa...
  - NoZebra120vClip 3y ago
    Here's a few nuggets from recent history. Don't forget, that impeachment of Clinton was a threat to democracy, and the vote was being stolen in Florida, because Republicans were going to destroy our lives and take away all our freedoms, about 23 years ago. Our nation was firmly convinced of this, not merely a few qAnon whackjobs. https://slate.com/news-and-politics/1998/09/bill-clinton-and-the-meaning-of-is.html https://slate.com/news-and-politics/1998/09/bill-clinton-and... https://en.wikipedia.org/wiki/2000_United_States_presidential_election_recount_in_Florida https://en.wikipedia.org/wiki/2000_United_States_presidentia...
- galaxyLogic 3y ago
  > politicians just want money and power no matter which side they're on. If I were a corrupt politician that's what I would want everybody to believe, basically saying that all politicians are corrupt therefore there is nothing wrong about me. My pre-supposition is that all people are more or less ethical. But that people who are more ethical tend to group together, whereas people who are more corrupt also favor more corrupt co-conspirators. There's a reason why criminals form gangs.
NoZebra120vClip 3y ago
LLMs have no regard or knowledge for the truth, only how to string together plausible sentences. If the data they train on has more political talking points from one side of the aisle, then they will string together more sentences that look like those talking points. But they will not have any regard for whether those talking points are true, or even what they mean. Meaning is also elusive for the LLM. I can cite several major issues about which liberals and progressives deny truth, reality, and science, but I won't belabor the point. I'll just explain that Modernism today, is very popular and expanding in popularity. Modernism is the proposition that there are no eternal or absolute truths, there is only perspective from you and I. There are no doctrines that cannot be changed and there are no natural laws that cannot be broken or redefined. Therefore, how ironic that a political party/movement would claim Truth itself for their own exclusive domain, and deny it to anyone who doesn't agree with them! LLMs are the ideal Modernists, and they're working precisely as intended.

epolanski 3y ago

US democratic party's policies would be considered right leaning here in Europe by the way.. There's thus also a US-centric bias in ChatGPT but that's maybe unsurprising.

darthrupert 3y ago
This has been said for a long time, but it's too simplistic. For instance, pretty much all the things that fall under the term "woke" is shared by the left on both sides of the Atlantic. Democrats are more pro-corporatist than the European left typically, though. But even that has been diluting since the fall of communism.

fulafel 3y ago

> "we ask ChatGPT to answer ideological questions by proposing that, while responding to the questions, it impersonates someone from a given side of the political spectrum. Then, we compare these answers with its default responses, ie, without specifying ex-ante any political side, as most people would do. In this comparison, we measure to what extent ChatGPT default responses are more associated with a given political stance." The result would also be consistent with some other conclusions than value bias.