3 ms·
Just out of curiosity, why do you need a reverse proxy? Couldn't you connect to that openai-compatible server directly?
by cgrs 3y ago
Just out of curiosity, why do you need a reverse proxy? Couldn't you connect to that openai-compatible server directly?
- SushiHippie 3y agoThanks, I don't know why I didn't think of that. Just tried it and it works at least with the llama-cpp-python server, but I suppose some other servers and very likely hosted services (SNI, certificate subjects, ...) would have problems with that.