2 ms·

This is a great point. Context size has a large impact on memory requirements and Ollama should take this into account (something to work on :)

• insanitybit 3y ago
  Thanks for the work you've done already :D