3 ms·
That is 180 billion parameters not 180 bytes, for anyone else confused.
by TrendyCPU 3y ago
That is 180 billion parameters not 180 bytes, for anyone else confused.
- toxik 3y agoYep and 16 bits per parameter means 360 GiB, then because you typically first allocate an empty model then separately load the weights, 720 GiB.