4 ms·
Super cool! Also with `--fit on` you don't need `--ctx-size 32768` technically anymore - llama-server will auto determine the max context size!
by danielhanchen 8mo ago
Super cool! Also with `--fit on` you don't need `--ctx-size 32768` technically anymore - llama-server will auto determine the max context size!
- genpfault 8mo agoNifty, thanks for the heads-up!