4 ms·You can run a 7b Q4 model in your 12gb vram no problem.by idonotknowwhy 3y agoYou can run a 7b Q4 model in your 12gb vram no problem.