3 ms·
Is there are Dreambooth equivalent for fine-tuning ChatGPT as there is for Stable Diffusion? I have to imagine that if we can add custom data to a DL text-to-im
by nomagicbullet 3y ago
Is there are Dreambooth equivalent for fine-tuning ChatGPT as there is for Stable Diffusion? I have to imagine that if we can add custom data to a DL text-to-image model, we should be able to do the same with a text-to-text one.
Edit to add: There are a number of Google Colabs for fine-tuning SD and I wonder if there are (or if it is technically feasible) to accomplish the same with other txt2txt models.
- SparkyMcUnicorn 3y agoThese aren't for ChatGPT, but work on LLaMA, Vicuna, etc. https://github.com/oobabooga/text-generation-webui/blob/main/docs/Training-LoRAs.md https://github.com/oobabooga/text-generation-webui/blob/main... https://github.com/zetavg/LLaMA-LoRA-Tuner https://github.com/zetavg/LLaMA-LoRA-Tuner https://github.com/h2oai/h2o-llmstudio https://github.com/h2oai/h2o-llmstudio https://github.com/rhulha/lora https://github.com/rhulha/lora
- a5huynh 3y agoIf you're running the text-generation-webui (https://github.com/oobabooga/text-generation-webui https://github.com/oobabooga/text-generation-webui) it has the ability to train LoRAs. It'll require a beefy GPU but I've seen some fun examples like someone training a LoRA on Skyrim books.