3 ms·The 4GB model is 7B, AFAIK. It’s just quantized down to 4 bits instead of 16.by chipsa 4y agoThe 4GB model is 7B, AFAIK. It’s just quantized down to 4 bits instead of 16.