3 ms·175B and rumored 1.76T paramsby pizza 3y ago175B and rumored 1.76T paramsk__ 3y agoHow much on disk?pizza 3y agoif fp32, 4 bytes per param. but the weights may have been quantized to lower precision (eg fp16, so 2B/p)ponyous 3y agoGPT3: 175B * 4 = 600GB GPT4: 4 * 1.76T = 7TB That feels too much, but I have no idea tbh.k__ 3y agoDoes it? IDK... Nevertheless, it would be cool if it could be reduced 95% in the future, haha.