3 ms·

"all tweaked to be much more PC and non-offensive." No, that's not why. An LLM was instructed to do prompt injection into image generations to increase diversi

"all tweaked to be much more PC and non-offensive." No, that's not why. An LLM was instructed to do prompt injection into image generations to increase diversity. The 2nd red pill is Open AI does this but you hear 0 about it because people enjoy ranting about what is in front of them much more than curiosity. Yesterday, prompt: founding fathers Injected: "...Caucasian, Black, and South Asian, their gender ratios balanced" https://x.com/jpohhhh/status/1772668958581150080?s=20 https://x.com/jpohhhh/status/1772668958581150080?s=20

simonw 3y ago
Yeah, I'm surprised how little comparison there was to how DALL-E prompting works given it has very similar rules baked in: https://simonwillison.net/2023/Oct/26/add-a-walrus/#the-leaked-dall-e-prompt https://simonwillison.net/2023/Oct/26/add-a-walrus/#the-leak...
h4ch1 3y ago
That was one example, in an ideal world where an LLM just spouts out human knowledge, there are no holds barred. There's enough literature online, blog posts, textfiles on how to synthesize drugs, build your own weapons, but try prompting GPT, Gemini or any other major LLM out there you'd get a virtue signalling paragraph on why you're a bad person for even thinking about this. Personally I don't care about this stuff, but in principle, the lack of the former points to LLMs being tweaked to be "safe".
- anoncareer0212 3y ago
  I don't think you're going to find much support for: A) "virtue signalling is when you don't give me drug recipes and 'build weapon' instructions" B) "Private company LLMs are morally wrong to virtue signal (as I defined it in A)" I'm sorry. I wish the best for everyone and hope they can live in their own best possible world, and in this case...better to break the news, than let you hope for it eternally in disappointment, which feels Sisyphus-ian/I'm infantalizing you. Happy to discuss more on why there isn't majority support for instant on-demand distribution of drug and weapon recipes, I don't want you to feel like I'm just asserting something.

simonw 3y ago

Yeah, I'm surprised how little comparison there was to how DALL-E prompting works given it has very similar rules baked in: https://simonwillison.net/2023/Oct/26/add-a-walrus/#the-leaked-dall-e-prompt https://simonwillison.net/2023/Oct/26/add-a-walrus/#the-leak...

h4ch1 3y ago

That was one example, in an ideal world where an LLM just spouts out human knowledge, there are no holds barred. There's enough literature online, blog posts, textfiles on how to synthesize drugs, build your own weapons, but try prompting GPT, Gemini or any other major LLM out there you'd get a virtue signalling paragraph on why you're a bad person for even thinking about this. Personally I don't care about this stuff, but in principle, the lack of the former points to LLMs being tweaked to be "safe".

anoncareer0212 3y ago
I don't think you're going to find much support for: A) "virtue signalling is when you don't give me drug recipes and 'build weapon' instructions" B) "Private company LLMs are morally wrong to virtue signal (as I defined it in A)" I'm sorry. I wish the best for everyone and hope they can live in their own best possible world, and in this case...better to break the news, than let you hope for it eternally in disappointment, which feels Sisyphus-ian/I'm infantalizing you. Happy to discuss more on why there isn't majority support for instant on-demand distribution of drug and weapon recipes, I don't want you to feel like I'm just asserting something.