3 ms·
Cloudflare has it https://developers.cloudflare.com/workers-ai/models/llava-1.5-7b-hf/ https://developers.cloudflare.com/workers-ai/models/llava-1.... Locally
by xyc 2y ago
Cloudflare has it https://developers.cloudflare.com/workers-ai/models/llava-1.5-7b-hf/ https://developers.cloudflare.com/workers-ai/models/llava-1....
Locally it's actually quite easy to setup. I've made an app https://recurse.chat/ https://recurse.chat/ which supports Llava 1.6. It takes a zero-config approach so you can just start chatting and the app downloads the model for you.
- xyc 2y agoJust realized I read your blog about Llava llamafile which got me interested in local AI and made the app :) What's your reservation about running it locally?