5 ms·
Yes, this appears to be entirely educational. No. Despite the name, llama.cpp supports more than just llama. It also isn’t an entirely bespoke thing as you ind
by coder543 3y ago
Yes, this appears to be entirely educational.
No. Despite the name, llama.cpp supports more than just llama. It also isn’t an entirely bespoke thing as you indicate, since it is built on the more general purpose “ggml” tensor library/framework.
- slimsag 3y agoI am very confused; so llama.cpp supports other non-llama models.. but is also based on the general-purpose ggml library? so llama.cpp is actually 'generic LLM framework' while ggml is 'generic ML framework'?
- coder543 3y ago> so llama.cpp is actually 'generic LLM framework' while ggml is 'generic ML framework'? That seems like a reasonable description to me, but I’m not an expert, just someone who is interested in this stuff.
- sanxiyn 3y agoYes. You can consider ggml akin to PyTorch, and llama.cpp like Transformers (by Hugging Face).