3 ms·
You only need an LLM for this if you want the background to be a direct result of the context you put it in. It's possible, but risky, since it's our of your h
by DrSiemer 2y ago
You only need an LLM for this if you want the background to be a direct result of the context you put it in.
It's possible, but risky, since it's our of your hands what the model will create. The current models do not have a foolproof method to keep output safe. You may end up with some, shall we say, interesting promotional material.
- Hammad_Ahmad 2y agoIt make sense to me. What if we use tool or some sort of service for doing this?
- DrSiemer 2y agoIt kind of depends on your goal. In most cases, pregenerating your images is a much better option, especially if you want a decent resolution. Why do they have to be dynamic? It would be a cool project, but you'd probably have to whitelist any context input. For dynamic images I would stick to an image generation model myself, for the best result with the least resources and complexity. I'd probably go for SDXL or an upscaled SD1.5 model, because you need a fair amount of control to get this right. You will have to craft a nice prompt, like "empty stage with [best suited whitelisted word from context] in the backdrop", guide this through a ControlNet to get somewhat consistent output, add one or two LoRa's for consistency in style (these can be randomized for more variation) and then just manually composite your product over it with some outer glow. Be aware though, image models really do not like to create images with "nothing" in the center. You may need some additional mask trickery to get it right.