4 ms·
Since most LLMs are released as FP16, just the number of parameters is enough to know the total required GPU RAM.
by tarruda 2y ago
Since most LLMs are released as FP16, just the number of parameters is enough to know the total required GPU RAM.