3 ms·
https://github.com/ggerganov/llama.cpp/tree/master/examples/rpc https://github.com/ggerganov/llama.cpp/tree/master/examples/... you run that on the remote node
by Palomides 2y ago
https://github.com/ggerganov/llama.cpp/tree/master/examples/rpc https://github.com/ggerganov/llama.cpp/tree/master/examples/...
you run that on the remote nodes