3 ms·
I always feel better when surveys are done by impartial researchers. Is this the case here? I looked to see if Pi.ai’s LLM was open and available, and I didn’t
by mark_l_watson 3y ago
I always feel better when surveys are done by impartial researchers. Is this the case here?
I looked to see if Pi.ai’s LLM was open and available, and I didn’t see if it was available. I have a new strategy for using LLM APIs: I use FastChat with one of the Vicuna 7B, 13B, or 33B models - both the command line interface tool and the OpenAI API compatible APIs via the FastChat REST server. By setting environment variables, my code can switch to using the OpenAI APIs. I rent a Lambda Labs GPU server to run these models myself. This is the strategy I am also using in the book I just started writing “Safe For Humans AI” https://leanpub.com/safe-for-humans-AI https://leanpub.com/safe-for-humans-AI
- byteknight 3y agoI have been looking for a way to tie a NextJS app with second python server serving an OpenAI compatible apis that serve chains using langchain. I found LocalAI but it seems like it's everything I need except it's for local models only. I found a couple others as well but they all require rewriting or wrapping your code in some new paradigm. Does the solution you proposed offer a path for what i'm looking for?
- mark_l_watson 3y agoIt might. You need a GPU server running FastChat services.