3 ms·

Any ideas how they built "wokeness" into gemini AI. I've seen ppl suggest that its simply appending "and make this more diverse" to the user prompt? Is that all

Any ideas how they built "wokeness" into gemini AI. I've seen ppl suggest that its simply appending "and make this more diverse" to the user prompt? Is that all they are doing to generate "nazi soldiers are asian" pictures ?

anon291 3y ago
My guess is several rounds of RLHF or fine-tuning with some kind of curated 'woke' dataset. Alternatively, they trained a critic model that penalizes showing white people or other 'bad' representations and then fine tuned using that.
graemep 3y ago
How is this woke? It is not an unreasonable response to classify Hindu nationalism as fascist, particularly given fascism is hard to define.
- anon291 3y ago
  If it were just Modi, perhaps, but the model is now well-known for generating all kinds of politically controversial / flat out false things.
  - verdverm 3y ago
    That's pretty much all generative AI does. It makes things up by design
    - anon291 3y ago
      Most companies are attempting to fine-tune their models to output truth, or putting in place external systems that pick answers that are true.
- tekla 3y ago
  > particularly given fascism is hard to define Than don't throw around "fascist" as an insult, which seems to be incredibly common.
  - graemep 3y ago
    I agree. It is quite worry that the word fascist is used so loosely because we forget what it really means. Even worse, the same is happening to the better defined term Nazi.
  - atoav 3y ago
    As an aside, to judge whether something is fascist or not going through the 14 points made by Umberto Eco helps a lot: https://www.openculture.com/2016/11/umberto-eco-makes-a-list-of-the-14-common-features-of-fascism.html https://www.openculture.com/2016/11/umberto-eco-makes-a-list... Umberto Eco grew up during italian fascism so he kinda knew.
- tibbydudeza 3y ago
  The BJP ruling party and some of their politicians is clearly aligned with the goals of the RSS (Rashtriya Swayamsevak Sangh) a facist organization - you don't need to be woke but just read uncensored Indian press and see their gatherings where they prattle unsavory things about Indians who are Muslims.
dotnet00 3y ago
That was what I thought too, but it has to be more involved than that since otherwise fixing the model would just involve removing the prompt modification stuff, which shouldn't take the months I've been hearing it'll take to fix.

anon291 3y ago

My guess is several rounds of RLHF or fine-tuning with some kind of curated 'woke' dataset. Alternatively, they trained a critic model that penalizes showing white people or other 'bad' representations and then fine tuned using that.

graemep 3y ago

How is this woke? It is not an unreasonable response to classify Hindu nationalism as fascist, particularly given fascism is hard to define.

anon291 3y ago
If it were just Modi, perhaps, but the model is now well-known for generating all kinds of politically controversial / flat out false things.
- verdverm 3y ago
  That's pretty much all generative AI does. It makes things up by design
  - anon291 3y ago
    Most companies are attempting to fine-tune their models to output truth, or putting in place external systems that pick answers that are true.
tekla 3y ago
> particularly given fascism is hard to define Than don't throw around "fascist" as an insult, which seems to be incredibly common.
- graemep 3y ago
  I agree. It is quite worry that the word fascist is used so loosely because we forget what it really means. Even worse, the same is happening to the better defined term Nazi.
- atoav 3y ago
  As an aside, to judge whether something is fascist or not going through the 14 points made by Umberto Eco helps a lot: https://www.openculture.com/2016/11/umberto-eco-makes-a-list-of-the-14-common-features-of-fascism.html https://www.openculture.com/2016/11/umberto-eco-makes-a-list... Umberto Eco grew up during italian fascism so he kinda knew.
tibbydudeza 3y ago
The BJP ruling party and some of their politicians is clearly aligned with the goals of the RSS (Rashtriya Swayamsevak Sangh) a facist organization - you don't need to be woke but just read uncensored Indian press and see their gatherings where they prattle unsavory things about Indians who are Muslims.

dotnet00 3y ago

That was what I thought too, but it has to be more involved than that since otherwise fixing the model would just involve removing the prompt modification stuff, which shouldn't take the months I've been hearing it'll take to fix.