4 ms·

Should be more? I envisioned the user of this as kind of local koboldcpp or lmstudio users with limited resources

• drbscl 2mo ago
  I believe they report the configured window, right?
  • refsab 2mo ago
    yes they do. I thought you meant I should have a larger default. When you configure any model the context size that's reported is detectable