4 ms·

thanks for explaining! How much GPU memory would work nice with 68B?

• ukd1 4y ago
  they said 2g per 1 billion....and it's called 68B...I presume that's 68 billion... 68*2...so at least 136g?
  • vishal0123 4y ago
    68/2, not 682
    • boredemployee 4y ago
      So, if I understand correctly, that's what you need to run the best model? With GPU: VRAM + RAM >= 68/2 Without GPU: RAM >= 68/2
      • coldtea 4y ago
        Not sure about the "=" part. You'd want some memory for the compositor and other OS graphics, and regular RAM for OS and programs, no?