3 ms·
Why have that issue on ollama instead of llama.cpp?
by sroussey 3y ago
Why have that issue on ollama instead of llama.cpp?
- mirekrusin 3y agoBecause it's easier to pull off and experiment with it from ollama (ollama is just go wrapper around llama.cpp). Llama.cpp could have upstream support for it but for them to consider it will have to be ironed out idea. In llama.cpp support may have some different, more low level kind of support, I don't think it makes sense to attach state logic to text input there.