>I'm glad you're happy with the fact that LLaMA 30B (a 20gb file) can be evaluated with only 4gb of memory usage! Isn't LLaMA 30B a set of 4 files (60,59Gb)?

>I'm glad you're happy with the fact that LLaMA 30B (a 20gb file) can be evaluated with only 4gb of memory usage! Isn't LLaMA 30B a set of 4 files (60,59Gb)? -edit- nvm, It's quantized. My bad