3 ms·
It uses ollama which is based on llama.cpp, and adds a model library with dozens of models in all quant sizes.
by visarga 3y ago
It uses ollama which is based on llama.cpp, and adds a model library with dozens of models in all quant sizes.
- xyc 3y agono this doesn't use ollama, just based on llama.cpp.