3 ms·
Here's another open source alternative: https://github.com/6/openai-caching-proxy-worker https://github.com/6/openai-caching-proxy-worker
by transitivebs 4y ago
Here's another open source alternative: https://github.com/6/openai-caching-proxy-worker https://github.com/6/openai-caching-proxy-worker
- transitivebs 4y agoAaand another even simpler one: https://github.com/egoist/openai-proxy https://github.com/egoist/openai-proxy This one uses Reflare under the hood: https://github.com/xiaoyang-sde/reflare https://github.com/xiaoyang-sde/reflare
- justintorre75 4y agoThese are great! we looked into using reflare as well, however reflare does not support streaming at the moment. We are looking to give back to the community and add it for them. I opened this issue up last week https://github.com/xiaoyang-sde/reflare/issues/443 https://github.com/xiaoyang-sde/reflare/issues/443
- xasiimov 4y agoIt appears that the author has responded to the issue, but you haven't replied yet.
- mdaniel 4y agoWow, I had no idea GH allowed single character usernames; GL as well https://gitlab.com/0 https://gitlab.com/0