4 ms·
How this compare to just running llama.cpp locally?
by synaesthesisx 3y ago
How this compare to just running llama.cpp locally?
- mayankchhabra 3y agoIt's an entire app (with a chatbot UI) that takes away the technical legwork to run the model locally. It's a simple one line `docker compose up -d` on any machine, or one click install on umbrelOS home servers.