2 ms·
Quite the opposite, you want something below your max VRAM and you use up to your max VRAM for the context window, so it can run longer. https://huggingface.co
by giancarlostoro 4mo ago
Quite the opposite, you want something below your max VRAM and you use up to your max VRAM for the context window, so it can run longer.
https://huggingface.co/Jackrong/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled https://huggingface.co/Jackrong/Qwen3.5-27B-Claude-4.6-Opus-...
- dgellow 4mo agoSorry, I meant a 24GB MacBook Pro model, to run a 16GB LLM :) My use of the term model here is confusing