4 ms·

Some feedback on workflow: - Automatic1111 outpainting works well but you need to enable the outpainting script. I would recommend Outpainting MK2. What the

Some feedback on workflow: - Automatic1111 outpainting works well but you need to enable the outpainting script. I would recommend Outpainting MK2. What the author did was just resize with fill which doesn't do any diffusion on the outpainted sections. - There are much better resizing workflows, at a minumum I would recommend using the "SD Upscale Script". However you can get great results by resizing the image to high-res (4-8k) using lanczos then using inpainting to manually diffuse the image at a much higher resolution with prompt control. In this case "SD Upscale" is fine but the inpaint based upscale works well with complex compositions. - When training I would typically recommend to keep the background. This allows for a more versitile finetuned model. - You can get a lot more control of final output by using ControlNet. This is especially great if you have illustration skills. But it is also great to generate varitions in a different style but keep the composition and details. In this case you could have taken a portrait photo of the subject and used ControlNet to adjust the style (without and finetuning required).

jakedahn 3y ago
Thank you for these recommendations! I'll definitely be trying them next time 'round.
- pjgalbraith 3y ago
  Good luck! I have some workflow videos on Youtube https://youtube.com/pjgalbraith https://youtube.com/pjgalbraith. But I haven't had a chance to show off all the latest techniques yet.
raincole 3y ago
> However you can get great results by resizing the image to high-res (4-8k) using lanczos then using inpainting to manually diffuse the image at a much higher resolution with prompt control. Diffuse an 8k image? Isn't it going to take much, much more VRAM tho?
- SV_BubbleTime 3y ago
  That confused me at first too.You aren’t diffusing the 8k image. You are upsampling, then inpainting sections that need it. So if you took your 8K and inpainted a section with 1024x1024 that works well with normal ram usages. In Auto1111, you need to select “inpainted masked area” to do that.
  - pjgalbraith 3y ago
    Yeah exactly this. It doesn't need more VRAM since you inpaint small sections (~512x515) of the image manually. It takes more time but gives the best results. The automated equivalent is SD Upscale or TiledVAE
- thot_experiment 3y ago
  For what it's worth if you actually want to get help on the state of the art on this stuff the best place to ask is the 4chan /g/ /sdg/ threads, and you can absolutely diffuse images that large using TiledVAE and Mixture of Diffusers or Multidiffusion, both of which are part of the Tiled Diffusion plugin for auto1111. https://i.imgur.com/zOMarKc.jpg https://i.imgur.com/zOMarKc.jpg Here's an example using various techniques I've gathered from those 4chan threads. (yes I know it's 4chan but just ignore the idiots and ask for catboxes, you'll learn much faster than anywhere else, at least that was the case for me after exhausting the resources on github/reddit/various discords)
  - thunderbong 3y ago
    This is amazing. Do you have some place where you've put up your work?
    - thot_experiment 3y ago
      I appreciate it, I'm trying to be a great artist here so this isn't really my work, it's 90% stolen from anons on 4chan. ;) I post on twitter[0] a reasonable bit but SD art isn't a big focus for me. I also recently started a patreon which is another post in this thread if you're interested in supporting. [0] https://twitter.com/thot_exper1ment https://twitter.com/thot_exper1ment
smusamashah 3y ago
For outpainting there are these two amazing tools which give you a canvas to do stuff https://github.com/zero01101/openOutpaint https://github.com/zero01101/openOutpaint https://github.com/BlinkDL/Hua https://github.com/BlinkDL/Hua Both use automatic1111 API for the work.

jakedahn 3y ago

Thank you for these recommendations! I'll definitely be trying them next time 'round.

pjgalbraith 3y ago
Good luck! I have some workflow videos on Youtube https://youtube.com/pjgalbraith https://youtube.com/pjgalbraith. But I haven't had a chance to show off all the latest techniques yet.

raincole 3y ago

> However you can get great results by resizing the image to high-res (4-8k) using lanczos then using inpainting to manually diffuse the image at a much higher resolution with prompt control. Diffuse an 8k image? Isn't it going to take much, much more VRAM tho?

SV_BubbleTime 3y ago
That confused me at first too.You aren’t diffusing the 8k image. You are upsampling, then inpainting sections that need it. So if you took your 8K and inpainted a section with 1024x1024 that works well with normal ram usages. In Auto1111, you need to select “inpainted masked area” to do that.
- pjgalbraith 3y ago
  Yeah exactly this. It doesn't need more VRAM since you inpaint small sections (~512x515) of the image manually. It takes more time but gives the best results. The automated equivalent is SD Upscale or TiledVAE
thot_experiment 3y ago
For what it's worth if you actually want to get help on the state of the art on this stuff the best place to ask is the 4chan /g/ /sdg/ threads, and you can absolutely diffuse images that large using TiledVAE and Mixture of Diffusers or Multidiffusion, both of which are part of the Tiled Diffusion plugin for auto1111. https://i.imgur.com/zOMarKc.jpg https://i.imgur.com/zOMarKc.jpg Here's an example using various techniques I've gathered from those 4chan threads. (yes I know it's 4chan but just ignore the idiots and ask for catboxes, you'll learn much faster than anywhere else, at least that was the case for me after exhausting the resources on github/reddit/various discords)
- thunderbong 3y ago
  This is amazing. Do you have some place where you've put up your work?
  - thot_experiment 3y ago
    I appreciate it, I'm trying to be a great artist here so this isn't really my work, it's 90% stolen from anons on 4chan. ;) I post on twitter[0] a reasonable bit but SD art isn't a big focus for me. I also recently started a patreon which is another post in this thread if you're interested in supporting. [0] https://twitter.com/thot_exper1ment https://twitter.com/thot_exper1ment

smusamashah 3y ago

For outpainting there are these two amazing tools which give you a canvas to do stuff https://github.com/zero01101/openOutpaint https://github.com/zero01101/openOutpaint https://github.com/BlinkDL/Hua https://github.com/BlinkDL/Hua Both use automatic1111 API for the work.