4 ms·
Video models are zero-shot learners and reasoners
- liuliu 1y agoVery interesting read. I first learned this method from a random reddit post a while ago and very happy to see a systematic study on this (wish I would save the original post somewhere to reference to!).
- ThouYS 1y agomaybe we really are headed to The One Model that can do it all
- nothrowaways 1y agoMultimodal models do it already.
- ricardobeat 1y agoIs it possible to use a model trained on video to output single frames?
- efskap 1y agoYup, people have been using local video models like Wan2.2 to generate stills, finding that for some things like human anatomy, it can outperform image generation models. Very cool how moving training data helps build spatial understanding that is applicable even to still images. [0] https://www.reddit.com/r/StableDiffusion/comments/1mcm7qm/wan_22_human_image_generation_is_very_good_this/ https://www.reddit.com/r/StableDiffusion/comments/1mcm7qm/wa...
- xnx 1y ago> for some things like human anatomy Pursuit of prurient interests has pioneered so many technologies: photography, videography, AI
- mallowdram 1y agoWhat is specific about this model? These categories aren't what defines intelligence in animal life. Segmentation is a post-hoc assertion into visual science, not necessarily an inside-out process inherent to perception. These models aren't the path, they're cheap workarounds that exclude the senses.
- ACCount37 1y ago[flagged]
- mallowdram 1y agoYou again? Learn some manners engineer.
- ACCount37 1y ago[flagged]
- mallowdram 1y ago[flagged]
- mallowdram 1y agoAnd, it will be easy. You've made junk tech from pseudoscience, classic houses of cards.
- ACCount37 1y agoIt's either a bot or a random internet schizophrenic.
- mallowdram 1y ago[flagged]
- pvillano 1y agoTo train an AI to solve problems, you train it extrapolate the future from a starting state of having a problem and the intention to solve the it. So much falls out of that reframing.
- pvillano 1y agoTraining is first done as a general predictive model: situation => result Then it's fine-tuned on: situation + intent => action => result
- miguel_martin 1y agoThis is incredible.