4 ms·
For inference and fine tuning yes, not training.
by bearjaws 3y ago
For inference and fine tuning yes, not training.
- YetAnotherNick 3y agoFine tuning is training. Just done on smaller and higher quality dataset. For pretraining, RAM is the least of the issue. Even for smallest llama 2 they used 12 years of A100 GPU time.