3 ms·
The llama.cpp server version runs a JSON API that you can call. It's currently missing any documentation though as far as I can tell - I found dome details on R
by simonw 3y ago
The llama.cpp server version runs a JSON API that you can call. It's currently missing any documentation though as far as I can tell - I found dome details on Reddit: https://www.reddit.com/r/LocalLLaMA/comments/185kbtg/llamacpp_server_rocks_now/ https://www.reddit.com/r/LocalLLaMA/comments/185kbtg/llamacp...
- zoe_dk 3y agoThank you Simon I will check it out.
- deleted 3y ago[deleted]