4 ms·
Is Qwen2.5-VL on Ollama? Could give it a try with a few of the schemas we have. We’ve locally tested with Llama 3.2 11B Vision on Ollama: https://github.com/vl
by fzysingularity 2y ago
Is Qwen2.5-VL on Ollama? Could give it a try with a few of the schemas we have.
We’ve locally tested with Llama 3.2 11B Vision on Ollama: https://github.com/vlm-run/vlmrun-hub/blob/main/tests/benchmarks/2025-01-10-llama3.2-vision:11b-instructor-results.md https://github.com/vlm-run/vlmrun-hub/blob/main/tests/benchm...
FWIW I think Ollama structured outputs API is quite buggy compared to the HF transformers variant.
- fzysingularity 2y agoJust ran them for Qwen2.5-VL: https://github.com/vlm-run/vlmrun-hub/blob/main/tests/benchmarks/2025-02-20-bsahane-Qwen2.5-VL-7B-Instruct-Q4_K_M_benxh-ollama-results.md https://github.com/vlm-run/vlmrun-hub/blob/main/tests/benchm...