5 ms·
Here is how hard it is to serve and use LLMs: https://github.com/ggerganov/llama.cpp https://github.com/ggerganov/llama.cpp
by choppaface 3y ago
Here is how hard it is to serve and use LLMs: https://github.com/ggerganov/llama.cpp https://github.com/ggerganov/llama.cpp
- doctor_eval 3y ago“The original implementation of llama.cpp was hacked in an evening.”