4 ms·
Can anyone (maybe ollama contributors) explain to me the relationship between llama.cpp and ollama? I always thought that ollama basically just was a wrapper (
by SushiHippie 3y ago
Can anyone (maybe ollama contributors) explain to me the relationship between llama.cpp and ollama?
I always thought that ollama basically just was a wrapper (i.e. not much changes to inference code, and only built on top) around llama.cpp, but this makes it seem like it is more than that?
- Zambyte 3y agollama.cpp also supports AMD cards: https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#hipblas https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#hi...