4 ms·

I wonder if they have a system prompt to promote diversity in outputs that touch on race at all? I’ve seen several instances of people requesting a photo of a s

I wonder if they have a system prompt to promote diversity in outputs that touch on race at all? I’ve seen several instances of people requesting a photo of a specific people, and it adds in more people to diversify. Not inherently bad, but it is if it forces it to provide incorrect answers like in your example.

robswc 3y ago
That's what I don't understand. I asked it why it assumed Native Americans were in Japan and it said: > I assumed [...] various ethnicities, including Indigenous American, due to the diversity present in Japan throughout history. However, this overlooked [...] I focused on providing diverse representations without adequately considering the specific historical context. I see no reason why this sort of thing won't extend to _all_ questions/prompts, so right now I have 0 reason to use Gemini over current models. From my testing and use, it isn't even better at anything to make fighting with it worth it.
- sorokod 3y ago
  Pretty funny as Japan is known to be one of the least ethnically diverse countries in the world.
margorczynski 3y ago
> Not inherently bad It is, it's consistently doing something the user didn't asked to and in most cases doesn't want. In many cases the model is completely unusable.
- selfmodruntime 3y ago
  Any computer program that does not deliver the expected output given a sufficient input is inherently bad.
  - trackflak 3y ago
    When Jesus said this: "What father among you, if his son asks for a fish, will instead of a fish give him a serpent?" (Luke 11) He was actually foretelling the future. He saw Gemini.
    - selfmodruntime 3y ago
      Hahaha. The man had a lot of wisdom, after all.
- cooper_ganglia 3y ago
  Yes, my wording was poor! I meant more in line with diversity isn’t inherently bad, of course, but it is when it’s shoehorned into results that are ultimately incorrect because of it.
summerlight 3y ago
I strongly suspect there's some DEI-driven system prompts without putting much thoughts. IMO it's okay to have restrictions, but they probably should've tested it not only against unsafe outputs but safe input as well.
int_19h 3y ago
It seems to be doing it for all outputs that depict people, in any context.

robswc 3y ago

That's what I don't understand. I asked it why it assumed Native Americans were in Japan and it said: > I assumed [...] various ethnicities, including Indigenous American, due to the diversity present in Japan throughout history. However, this overlooked [...] I focused on providing diverse representations without adequately considering the specific historical context. I see no reason why this sort of thing won't extend to _all_ questions/prompts, so right now I have 0 reason to use Gemini over current models. From my testing and use, it isn't even better at anything to make fighting with it worth it.

sorokod 3y ago
Pretty funny as Japan is known to be one of the least ethnically diverse countries in the world.

margorczynski 3y ago

> Not inherently bad It is, it's consistently doing something the user didn't asked to and in most cases doesn't want. In many cases the model is completely unusable.

selfmodruntime 3y ago
Any computer program that does not deliver the expected output given a sufficient input is inherently bad.
- trackflak 3y ago
  When Jesus said this: "What father among you, if his son asks for a fish, will instead of a fish give him a serpent?" (Luke 11) He was actually foretelling the future. He saw Gemini.
  - selfmodruntime 3y ago
    Hahaha. The man had a lot of wisdom, after all.
cooper_ganglia 3y ago
Yes, my wording was poor! I meant more in line with diversity isn’t inherently bad, of course, but it is when it’s shoehorned into results that are ultimately incorrect because of it.

summerlight 3y ago

I strongly suspect there's some DEI-driven system prompts without putting much thoughts. IMO it's okay to have restrictions, but they probably should've tested it not only against unsafe outputs but safe input as well.

int_19h 3y ago

It seems to be doing it for all outputs that depict people, in any context.