4 ms·Website says 320 GB for GPTQ / int4. I'm not sure why, my guess would be multi-head attentionby Taek 3y agoWebsite says 320 GB for GPTQ / int4. I'm not sure why, my guess would be multi-head attention