3 ms·
With `ollama run gemma3:27b-it-qat "What is blue"`, GPU memory usage is just a hair over 20GB, so no, probably not without a nerfed context window
by jffry 1y ago
With `ollama run gemma3:27b-it-qat "What is blue"`, GPU memory usage is just a hair over 20GB, so no, probably not without a nerfed context window
- woadwarrior01 1y agoIndeed, the default context length in ollama is a mere 2048 tokens.