3 ms·
Yep and 16 bits per parameter means 360 GiB, then because you typically first allocate an empty model then separately load the weights, 720 GiB.
by toxik 3y ago
Yep and 16 bits per parameter means 360 GiB, then because you typically first allocate an empty model then separately load the weights, 720 GiB.