3 ms·
Is there a way to make it work with ooba+exllama? (much faster than llamacpp)
by redox99 3y ago
Is there a way to make it work with ooba+exllama? (much faster than llamacpp)
- thelastparadise 3y agoYou should be able to turn on the API in booba: https://github.com/oobabooga/text-generation-webui#api https://github.com/oobabooga/text-generation-webui#api
- redox99 3y agoBut that API isn't OpenAI compatible AFAIK