> That would be like blaming DALL-E weirdness on GPT-4. Actually when you trigger DALL-E through GPT-4 (i.e. with the LLM generating the prompt to give the dif

> That would be like blaming DALL-E weirdness on GPT-4. Actually when you trigger DALL-E through GPT-4 (i.e. with the LLM generating the prompt to give the diffusion model then returning the resulting image to the user) the LLM's system instructions [1] say "7. Diversify depictions of ALL images with people to always include always DESCENT and GENDER for EACH person using direct terms." and a bunch of stuff along those lines. In OpenAI's system this doesn't always trigger; if the user asks for an image of trash being collected, the user hasn't explicitly asked for any people to be depicted, so the LLM doesn't find anything in the prompt that needs diversity added. The trash-being-collected prompt gets passed to DALL-E unmodified, and the resulting image has all male workers. [1] https://raw.githubusercontent.com/spdustin/ChatGPT-AutoExpert/main/_system-prompts/dall-e.md https://raw.githubusercontent.com/spdustin/ChatGPT-AutoExper...