You can't, it needs around 40GB of RAM. Technically you can by swapping to disk but it would be too slow to be usable. What you can do however is use the 7B m

You can't, it needs around 40GB of RAM. Technically you can by swapping to disk but it would be too slow to be usable. What you can do however is use the 7B model with 4bit quantization and use it within 8GB RAM.