3 ms·how much vram do you need for 4-bit llama 405?by coconut08 2y agohow much vram do you need for 4-bit llama 405?zargon 2y ago405 billion * 4 bits = approximately 200 GB. Plus extra for the amount of context you want.