4 ms·
Does it work with textual inversion? I've got Stable Diffusion set up and its works fine, but I get out of memory error on the textual inversion feature.
by macrolime 4y ago
Does it work with textual inversion? I've got Stable Diffusion set up and its works fine, but I get out of memory error on the textual inversion feature.
- pdntspa 4y agoWhat is textual inversion?
- macrolime 4y agoTextual inversion is teaching it a new concept, such as "Ugly Sonic", from a couple images. Then you get a file you can use in SD to use this new concept in prompts.
- montebicyclelo 4y agoNo, not currently. Textual inversion requires training the model, which requires gradients to be computed and stored in VRAM, which doesn't happen for normal inference, so larger than usual VRAM is required. You can do it in around 4 hours on Colab, using HuggingFace's notebook. https://colab.research.google.com/github/huggingface/notebooks/blob/main/diffusers/sd_textual_inversion_training.ipynb https://colab.research.google.com/github/huggingface/noteboo... Then you should be able to take the result (a single text token embedding) and use that locally. (I didn't realise you were talking about textual inversion in your original post.)
- macrolime 4y agoI tried with these pretrained embeddings, but haven't gotten them to run in inference locally without crashing yet. https://github.com/hlky/sd-embeddings https://github.com/hlky/sd-embeddings