3 ms·
I am very confused; so llama.cpp supports other non-llama models.. but is also based on the general-purpose ggml library? so llama.cpp is actually 'generic LLM
by slimsag 3y ago
I am very confused; so llama.cpp supports other non-llama models.. but is also based on the general-purpose ggml library?
so llama.cpp is actually 'generic LLM framework' while ggml is 'generic ML framework'?
- coder543 3y ago> so llama.cpp is actually 'generic LLM framework' while ggml is 'generic ML framework'? That seems like a reasonable description to me, but I’m not an expert, just someone who is interested in this stuff.
- sanxiyn 3y agoYes. You can consider ggml akin to PyTorch, and llama.cpp like Transformers (by Hugging Face).