5 ms·
Very cool! How many images did you use to create the LoRa of your dog? Do you have any guide to recommend?
by jononor 3y ago
Very cool! How many images did you use to create the LoRa of your dog? Do you have any guide to recommend?
- Auracle 3y agoIt was about 30 images, though I'm planning on adding more and training again sometime. Either that or splitting it up between when her hair is short and when it's long, as it really changes how she looks. This isn't what I used for my dog's LoRa but I used it for my wife and it worked better than what I was doing before (Adafactor): https://civitai.notion.site/SDXL-1-0-Training-Overview-4fb03d5b4cbf482ebe13ffef7bcb8ead https://civitai.notion.site/SDXL-1-0-Training-Overview-4fb03... I'd recommend increasing the network dimension to at least 64, if your VRAM can take it. I can do 64 with my 12GB card. At least for people, I've had better luck using a token that's a celebrity. I'm not sure how to try that with my dog - perhaps just "terrier dog" or something.
- jononor 3y agoThanks! Looks like I'll need to rent a GPU to use SDXL fine tuning. Poor old RTX2060 not gonna cut it.
- carbocation 3y agoThat's a very low learning rate -- between 2-3 orders of magnitude lower than what I've seen for that number of steps. I'll have to give it a try.
- Auracle 3y agoI should have been clear - I'm using the Prodigy settings on that page, not the Adafactor one. You set the learning rate to 1 and the scheduler to cosine, but the real learning rate is figured out by the optimizer.