3 ms·
From a personal perspective… I have a family photo collection going back decades that I used to put effort into tagging and describing, before realizing that au
by jl6 3y ago
From a personal perspective… I have a family photo collection going back decades that I used to put effort into tagging and describing, before realizing that automatic classification models would come eventually. After years of waiting, it feels like we’re close, but I’ve tried LLaVA-1.5 and it was underwhelming. Are there other more specialist models I should try? Must be open source and easy to invoke from a shell or Python script.
- Philpax 3y agoTry Fuyu-8B or CogVLM. Failing that, there’s always the GPT-4V API. There are also other non-LLM solutions for image captioning / tagging (e.g. what the smartphone vendors do), but I’m less familiar with those.
- stevenhuang 3y ago+1 on CogVLM. https://github.com/THUDM/CogVLM https://github.com/THUDM/CogVLM Recent discussions: https://github.com/ggerganov/llama.cpp/discussions/4350 https://github.com/ggerganov/llama.cpp/discussions/4350 It is the best open source vision language model out there that I'm aware of that's most comparable to gpt4v. Beats the pants off Llava1.5 and variants like bakllava. There's a demo here http://36.103.203.44:7861/ http://36.103.203.44:7861/
- em-bee 3y agoi have been watching this subthread in hope that something interesting might come out of it and you just delivered. this demo is amazing. i am now dying to apply this to my photo collection. on that note, some time ago i came across an image management tool that uses machine learning in some form. i don't have time to look for it now, but i just wanted to mention that someone is working on something like that.