3 ms·
You meant 700 GB? 32 bit precision in 175B model is around ~700GB + overhead or around 350 GB if they use half-precision.
by lossolo 4y ago
You meant 700 GB? 32 bit precision in 175B model is around ~700GB + overhead or around 350 GB if they use half-precision.
- motoboi 4y agoI was wrong. It seems they use fall precision. So 350gb. What is amazing, human language (languages?) and knowledge encoded in so little space.