3 ms·
I have been looking for a way to tie a NextJS app with second python server serving an OpenAI compatible apis that serve chains using langchain. I found LocalA
by byteknight 3y ago
I have been looking for a way to tie a NextJS app with second python server serving an OpenAI compatible apis that serve chains using langchain.
I found LocalAI but it seems like it's everything I need except it's for local models only.
I found a couple others as well but they all require rewriting or wrapping your code in some new paradigm.
Does the solution you proposed offer a path for what i'm looking for?
- mark_l_watson 3y agoIt might. You need a GPU server running FastChat services.