2 ms·
> Is it not possible to do finetuning on a 24GB 4090? Not for 70B. You can finetune 7B or 13B.
by brucethemoose2 3y ago
> Is it not possible to do finetuning on a 24GB 4090?
Not for 70B. You can finetune 7B or 13B.
- Tostino 3y agoYou can't FT 70b with 48gb of vram (2x 3090) either.