3 ms·
I guess llama.cpp isn't quite as popular as I had assumed.
by jasonjmcghee 9mo ago
I guess llama.cpp isn't quite as popular as I had assumed.
- avadodin 9mo agollama.cpp being the best choice doesn't make it popular. When I got started, I was led to ollama and other local-llm freemium. I didn't necessarily assume that they weren't c++(I don't even know) but I do think that –as implied– Python duct-tape solutions are more popular than llama.cpp.