3 ms·
Is it not possible to do finetuning on a 24GB 4090? I'm thinking about the best bang for the buck below $2k and the options are 2x3090 or 1x4090.
by behnamoh 3y ago
Is it not possible to do finetuning on a 24GB 4090? I'm thinking about the best bang for the buck below $2k and the options are 2x3090 or 1x4090.
- brucethemoose2 3y ago> Is it not possible to do finetuning on a 24GB 4090? Not for 70B. You can finetune 7B or 13B.
- Tostino 3y agoYou can't FT 70b with 48gb of vram (2x 3090) either.