3 ms·
Do you know of any good paid API providers offering LLAVA? I want to experiment with it out a bunch more without having to host it locally myself.
by simonw 2y ago
Do you know of any good paid API providers offering LLAVA? I want to experiment with it out a bunch more without having to host it locally myself.
- nikolayasdf123 2y agonope. I am self-hosting. support is pretty good actually. llama.cpp supports it (v1.6 too; and in openai API server as well). ollama supports it. open-web-ui chat too. using it now on desktop (I am in China, so no OpenAI here) and in cloud cluster on project.
- xyc 2y agoCloudflare has it https://developers.cloudflare.com/workers-ai/models/llava-1.5-7b-hf/ https://developers.cloudflare.com/workers-ai/models/llava-1.... Locally it's actually quite easy to setup. I've made an app https://recurse.chat/ https://recurse.chat/ which supports Llava 1.6. It takes a zero-config approach so you can just start chatting and the app downloads the model for you.
- xyc 2y agoJust realized I read your blog about Llava llamafile which got me interested in local AI and made the app :) What's your reservation about running it locally?
- bfirsh 2y agohttps://replicate.com/yorickvp/llava-13b https://replicate.com/yorickvp/llava-13b :)