3 ms·
No, not currently. Textual inversion requires training the model, which requires gradients to be computed and stored in VRAM, which doesn't happen for normal in
by montebicyclelo 4y ago
No, not currently. Textual inversion requires training the model, which requires gradients to be computed and stored in VRAM, which doesn't happen for normal inference, so larger than usual VRAM is required.
You can do it in around 4 hours on Colab, using HuggingFace's notebook. https://colab.research.google.com/github/huggingface/notebooks/blob/main/diffusers/sd_textual_inversion_training.ipynb https://colab.research.google.com/github/huggingface/noteboo...
Then you should be able to take the result (a single text token embedding) and use that locally.
(I didn't realise you were talking about textual inversion in your original post.)
- macrolime 4y agoI tried with these pretrained embeddings, but haven't gotten them to run in inference locally without crashing yet. https://github.com/hlky/sd-embeddings https://github.com/hlky/sd-embeddings