4 ms·With good quantization you can get 36GB down to 8GB. To get 36B down to 8B you need good pruning.by p1esk 1y agoWith good quantization you can get 36GB down to 8GB. To get 36B down to 8B you need good pruning.