6 ms·
Run it locally.
by nickthegreek 3y ago
Run it locally.
- lolinder 3y agoI haven't tried SD3, but my local SD2 regularly has this pattern where while the image is developing it looks like it's coming along fine and then suddenly in the last few rounds it introduces weird artifacts to mask faces. Running locally doesn't get around censorship that's baked into the model. I tend to lean towards SD1.5 for this reason—I'd rather put in the effort to get a good result out of the lesser model than fight with a black box censorship algorithm. EDIT: See the replies below. I might just have been holding it wrong.
- yreg 3y agoDo you use the proper refiner model?
- lolinder 3y agoProbably not, since I have no idea what you're talking about. I've just been using the models that InvokeAI (2.3, I only just now saw there's a 3.0) downloads for me [0]. The SD1.5 one is as good as ever, but the SD2 model introduces artifacts on (many, but not all) faces and copyrighted characters. EDIT: based on the other reply, I think I understand what you're suggesting, and I'll definitely take a look next time I run it. [0] https://github.com/invoke-ai/InvokeAI https://github.com/invoke-ai/InvokeAI
- yreg 3y agoSDXL should be used together with a refiner. You can usually see the refiner kicking in if you have a UI that shows you the preview of intermediate steps. And it can sometimes look like the situation you describe (straining further away from your desired result). Same goes for upscalers, of course.
- SV_BubbleTime 3y agoBasically don’t use SD2.x, it’s trash and the community rejected it. If you are using invoke, try XL. If you want to really dial into a specific style or apply a specific LORA, use 1.5.
- fnordpiglet 3y agoBe sure to turn off the refiner. This sounds like you’re making models that aren’t aligned with their base models and the refiner runs in the last steps. If it’s a prompt out of alignment with the default base model it’ll heavily distort. Personally with SDXL I never use the refiner I just use more steps.
- zettabomb 3y agoSD2 isn't SDXL. SD2 was a continuation of the original models that didn't see much success. It didn't have a refiner.
- cchance 3y agoWell ya because SD2 literally had purposeful censorship of the base model and the clip, that basically made it DOA to the entire opensource community that were dedicated to 1.5, SDXL wasnt so bad so it gained traction but still 1.5 is the king because it was from before the damn models were gimped at the knees and relied on workarounds and insane finetunes just to get basic anatomy correct.
- lolinder 3y agoThat makes sense. I'll try that next time!
- hizanberg 3y agoDon't expect my current desktop will be able to handle it, which is why I'm happy to pay for API access, but my next Desktop should be capable. Is the OSS'd version of SDXL less restrictive than their API hosted version?
- nickthegreek 3y agoIf you run into issues, switch to a fine-tuned model from civitai.
- yreg 3y agoYou can set up the same thing you would have locally on some spot cloud instance.
- Rastonbury 3y agoThat person would rather pay for API than set up locally (which is simple as unzip and add model), setting up in cloud can be painful if you aren't familiar