I don't know if it matters but the 7B parameter checkpoint is 13.5GB in size. Someone with 24GB VRAM struggled to run it: https://github.com/facebookresearch/l

I don't know if it matters but the 7B parameter checkpoint is 13.5GB in size. Someone with 24GB VRAM struggled to run it: https://github.com/facebookresearch/llama/issues/55 https://github.com/facebookresearch/llama/issues/55