3 ms·
In llama.cpp you can use a flag on ./main to set a custom context size, that can be up to 2048.
by logicchains 4y ago
In llama.cpp you can use a flag on ./main to set a custom context size, that can be up to 2048.
- bugglebeetle 4y agoAh, ok. I’ve been working with the Python bindings most recently and must have missed that.