5 ms·
Noob question - how might I call this from my Python script? Say as a replacement gpt3.5 turbo of sorts. Is there an option without GUI? This is great thank y
by zoe_dk 3y ago
Noob question - how might I call this from my Python script? Say as a replacement gpt3.5 turbo of sorts.
Is there an option without GUI?
This is great thank you, very user friendly (exhibit a: me)
- simonw 3y agoThe llama.cpp server version runs a JSON API that you can call. It's currently missing any documentation though as far as I can tell - I found dome details on Reddit: https://www.reddit.com/r/LocalLLaMA/comments/185kbtg/llamacpp_server_rocks_now/ https://www.reddit.com/r/LocalLLaMA/comments/185kbtg/llamacp...
- zoe_dk 3y agoThank you Simon I will check it out.
- deleted 3y ago[deleted]