3 ms·
From the abstract: [We] introduce Text-to-LoRA (T2L), a model capable of adapting large language models (LLMs) on the fly solely based on a natural language de
by magicalhippo 1y ago
From the abstract:
[We] introduce Text-to-LoRA (T2L), a model capable of adapting large language models (LLMs) on the fly solely based on a natural language description of the target task. T2L is a hypernetwork trained to construct LoRAs in a single inexpensive forward pass.
Code repository here: https://github.com/SakanaAI/text-to-lora https://github.com/SakanaAI/text-to-lora