I thought of this article: https://www.crosslabs.org/blog/diffusion-with-offset-noise https://www.crosslabs.org/blog/diffusion-with-offset-noise I don't know ho

I thought of this article: https://www.crosslabs.org/blog/diffusion-with-offset-noise https://www.crosslabs.org/blog/diffusion-with-offset-noise I don't know how much this applies to SDXL, but you might need a LORA to get very bright or very dark images. Gray could be a much easier targer.