2 ms·

Yeah, I'm aware, I just think it's an unusual default for a harness to use

• refsab 2mo ago
  Should be more? I envisioned the user of this as kind of local koboldcpp or lmstudio users with limited resources
  • drbscl 2mo ago
    I believe they report the configured window, right?
    • refsab 2mo ago
      yes they do. I thought you meant I should have a larger default. When you configure any model the context size that's reported is detectable