Definitely does not seem too far off: https://ollama.com/library/llama3/tags https://ollama.com/library/llama3/tags Llama3 8B fp16 is 16GB, q8 is 8.5GB and q4

Definitely does not seem too far off: https://ollama.com/library/llama3/tags https://ollama.com/library/llama3/tags Llama3 8B fp16 is 16GB, q8 is 8.5GB and q4 is between 4.3 and 4.9GB. Llama3 70B fp16 is 141GB, q8 75GB and q4 is between 40 and 43GB.