4 ms·
Not really. These are slightly better for memory during pre-training and fine turning but not enough to make a 4090 usable even for a 7b model.
by llm_trw 3y ago
Not really. These are slightly better for memory during pre-training and fine turning but not enough to make a 4090 usable even for a 7b model.