4 ms·
I wish multimodal would imply text, image and audio (+potentially video). If a model supports only image generation or image analysis, vision model seems the mo
by oezi 1y ago
I wish multimodal would imply text, image and audio (+potentially video). If a model supports only image generation or image analysis, vision model seems the more appropriate term.
We should aim to distinguish multimodal modals such as Qwen2.5-Omni from Qwen2.5-VL.
In this sense: Ollama's new engine adds vision support.
- deleted 1y ago[deleted]
- prettyblocks 1y agoI'm very interested in working with video inputs, is it possible to do that with Qwen2.5-Omni and Ollama?
- oezi 1y agoI have only tested Qwen2.5-Omni for audio and it was hit and miss for my use case of tagging audio.
- machinelearning 1y agoWhat's a use case are you interested in re: video?
- prettyblocks 1y agoI'm curious how effective these models would be at recognizing if the input video was ai generated or heavily manipulated. Also various things around face/object segmentation.
- tough 1y agohttps://huggingface.co/blog/smolvlm https://huggingface.co/blog/smolvlm