5 ms·

OpenAI already experienced this backlash when it was injecting words for diversity into prompts (hilariously if you asked for your prompt back it would include

OpenAI already experienced this backlash when it was injecting words for diversity into prompts (hilariously if you asked for your prompt back it would include the words, and supposedly you could get it to render the extra words onto signs within the image). How could Google have made the same mistake but worse?

Mountain_Skies 3y ago
Perhaps the overtness was intentional, made by someone in the company who doesn't like the '1984' world Google is building, and saw this as a good opportunity to alert the world with plausible deniability.
- DonHopkins 3y ago
  [flagged]
  - louthy 3y ago
    ‘1984’ is a book
    - DonHopkins 3y ago
      [flagged]
      - slater- 3y ago
        I thought the original title was something like The Last Man In Europe.
exitb 3y ago
DALL-E is still prompted with diversity in mind. It's just not over the top. People don't mind to receive diverse depictions when they make sense for a given context.
- deleted 3y ago
  [deleted]
Simulacra 3y ago
Allowing a political agenda to drive the programming of the algorithm instead of engineering.
- John23832 3y ago
  Algorithms and engineering that make non binary decisions inherently have the politics of the creator embedded. Sucks that is life.
  - kromem 3y ago
    Tell that to Grok: https://www.zdnet.com/article/i-tried-xs-anti-woke-grok-ai-chatbot-the-results-were-the-opposite-of-what-i-expected/ https://www.zdnet.com/article/i-tried-xs-anti-woke-grok-ai-c...
  - hot_gril 3y ago
    This is true not just about politics but about thinking style in general. Why does every desktop OS have a filesystem? It's not that it's the objectively optimal approach or something, it's that humans have an easy time thinking about files.
- dkjaudyeqooe 3y ago
  It a product that the company has to take responsibility for. Managing that is a no brainer. Tf they don't they suffer endless headlines damaging their brand. The only political agenda present is yours. You see everything through the kaleidoscope of your own political grievances.
is_true 3y ago
It makes sense considering they have a bigger PR department
deleted 3y ago
[deleted]
JeremyNT 3y ago
I think it's pretty clear that they're trying to prevent one class of issues (the model spitting out racist stuff in one context) and have introduced another (the model spitting out wildly inaccurate portrayals of people in historical contexts). But thousands of end users are going to both ask for and notice things that your testers don't, and that's how you end up here. "This system prompt prevents Gemini from promoting Naziism successfully, ship it!" This is always going to be a challenge with trying to moderate or put any guardrails on these things. Their behavior is so complex it's almost impossible to reason about all of the consequences, so the only way to "know" is for users to just keep poking at it.

Mountain_Skies 3y ago

Perhaps the overtness was intentional, made by someone in the company who doesn't like the '1984' world Google is building, and saw this as a good opportunity to alert the world with plausible deniability.

DonHopkins 3y ago
[flagged]
- louthy 3y ago
  ‘1984’ is a book
  - DonHopkins 3y ago
    [flagged]
    - slater- 3y ago
      I thought the original title was something like The Last Man In Europe.

exitb 3y ago

DALL-E is still prompted with diversity in mind. It's just not over the top. People don't mind to receive diverse depictions when they make sense for a given context.

deleted 3y ago
[deleted]

Simulacra 3y ago

Allowing a political agenda to drive the programming of the algorithm instead of engineering.

John23832 3y ago
Algorithms and engineering that make non binary decisions inherently have the politics of the creator embedded. Sucks that is life.
- kromem 3y ago
  Tell that to Grok: https://www.zdnet.com/article/i-tried-xs-anti-woke-grok-ai-chatbot-the-results-were-the-opposite-of-what-i-expected/ https://www.zdnet.com/article/i-tried-xs-anti-woke-grok-ai-c...
- hot_gril 3y ago
  This is true not just about politics but about thinking style in general. Why does every desktop OS have a filesystem? It's not that it's the objectively optimal approach or something, it's that humans have an easy time thinking about files.
dkjaudyeqooe 3y ago
It a product that the company has to take responsibility for. Managing that is a no brainer. Tf they don't they suffer endless headlines damaging their brand. The only political agenda present is yours. You see everything through the kaleidoscope of your own political grievances.

is_true 3y ago

It makes sense considering they have a bigger PR department

deleted 3y ago

[deleted]

JeremyNT 3y ago

I think it's pretty clear that they're trying to prevent one class of issues (the model spitting out racist stuff in one context) and have introduced another (the model spitting out wildly inaccurate portrayals of people in historical contexts). But thousands of end users are going to both ask for and notice things that your testers don't, and that's how you end up here. "This system prompt prevents Gemini from promoting Naziism successfully, ship it!" This is always going to be a challenge with trying to moderate or put any guardrails on these things. Their behavior is so complex it's almost impossible to reason about all of the consequences, so the only way to "know" is for users to just keep poking at it.