4 ms·
I wonder how much it would take to train the 4b 13B
by seydor 4y ago
I wonder how much it would take to train the 4b 13B
- MacsHeadroom 4y agoAbout 15GB training it in the webui. If you use https://github.com/johnsmith0031/alpaca_lora_4bit https://github.com/johnsmith0031/alpaca_lora_4bit then 30B only needs 24GB, and works on a single 3090 or $200 P40.