2 ms·

This has a list of models and their VRAM requirements https://www.reddit.com/r/LocalLLaMA/comments/11o6o3f/how_to_install_llama_8bit_and_4bit/ https://www.redd

by seydor 4y ago

This has a list of models and their VRAM requirements https://www.reddit.com/r/LocalLLaMA/comments/11o6o3f/how_to_install_llama_8bit_and_4bit/ https://www.reddit.com/r/LocalLLaMA/comments/11o6o3f/how_to_...