2 ms·

Ask HN: How to create llama.cpp LAN server on a Mac Studio?

3 points by behnamoh 3y ago

I know how to use llama.cpp and run local servers in terminal, but I want to be able to send API requests from other machines on the network (or even out of network if it's possible). This Mac Studio is located in my company office and I should use the company VPN to connect to it (I can SSH or do Screen Sharing).

sequoiar68 3y ago
try to setup peer-proxy to expose local web service https://github.com/InstantWebP2P/peer-proxy https://github.com/InstantWebP2P/peer-proxy
- drunkenmagician 3y ago
  Also ngrok - https://ngrok.com https://ngrok.com
  - behnamoh 3y ago
    Thanks to both of you, I will check out these options.
Hammudi502 3y ago
[flagged]