3 ms·
What are you using to run it? I haven't got image input working yet myself.
by simonw 2y ago
What are you using to run it? I haven't got image input working yet myself.
- trebligdivad 2y agoI'm using llama.cpp - built last night from head; to do image stuff you have to run a separate client they provide, with something like: ./build/bin/llama-gemma3-cli -m /discs/fast/ai/gemma-3-27b-it-q4_0.gguf --mmproj /discs/fast/ai/mmproj-model-f16-27B.gguf -p "Describe this image." --image ~/Downloads/surprise.png Note the 2nd gguf in there - I'm not sure, but I think that's for encoding the image.
- terhechte 2y agoImage input has been working with LM Studio for quite some time
- tough 2y agoneed it here for cli usage! https://github.com/agustif/llm-lmstudio https://github.com/agustif/llm-lmstudio