7 ms·
Not nearly as impressive as Sora. Sora was impressive because the clips were long and had lots of rapid movement since video models tend to fall apart when the
by popcar2 2y ago
Not nearly as impressive as Sora. Sora was impressive because the clips were long and had lots of rapid movement since video models tend to fall apart when the movement isn't easy to predict.
By comparison, the shots here are only a few seconds long and almost all look like slow motion or slow panning shots cherrypicked because they don't have that much movement. Compare that to Sora's videos of people walking in real speed.
The only shot they had that can compare was the cyberpunk video they linked to, and it looks crazy inconsistent. Real shame.
- nuz 2y agoSora is also movement limited to a certain range if you look at the clips closely. Probably something like filtering by some function of optical flow in both cases.
- ein0p 2y agoAlso Sora demos had some really impressive generations featuring _people_. Here we hardly see any people which likely means exactly what you’d guess.
- data-ottawa 2y agoHas Gemini started generated impacted of people again? My trial has ended and I haven’t been following the issue.
- spiderfarmer 2y agoAlso the horse just looks weird, just like the buildings and peppers. It's impressive as hell though. Even if it would only be used to extrapolate existing video.
- LZ_Khan 2y agoI imagine thats just a function of how much training data you throw at it.
- Jensson 2y ago> Sora was impressive because the clips were long and had lots of rapid movement Sora videos ran at 1 beat per second, so everything in the image moved at the same beat and often too slow or too fast to keep the pace. It is very obvious when you inspect the images and notice that there are keyframes at every whole second mark and everything on the screen suddenly goes in their next animation step. That really limits the kind of videos you can generate.
- lupire 2y agoSo it needs to learn how far each object can travel in 1sec at its natural speed?
- Jensson 2y agoIt also needs to separate animation steps for different objects so that objects can keep different speeds. It isn't trivial at all to go from having a keyframe for the whole picture to having separate for separate parts, you need to retrain the whole thing from the ground up and the results will be way worse until you figure out a way to train that. My point is that it isn't obvious at all that Soras way actually is closer to the end goal, it might look better today to have those 1 second beats for every video but where do you go from there?
- Aerroon 2y agoThe best case scenario would probably being able to generate "layers" at a time. That would give more creative control over the outcome, but I have no idea how you would do it.
- deleted 2y ago[deleted]
- TIPSIO 2y agoObjectively speaking (if people would be honest with themselves), both are just decent at best. I think comparing them now is probably not that useful outside of this AI hype train. Like comparing two children. A lot can happen. The bigger message I am getting from this is it's clear OpenAI won't have a super AI monopoly.
- TaylorAlexander 2y agoComparing two children is a good one. My girlfriend has taken to pointing out when I’m engaging in “punditry”. They're an engineer like I am and we talk about tech all the time, but sometimes I talk about which company is beating which company like it’s a football game, and they call me out for it. Video models are interesting, and to some extent trying to imagine which company is gonna eat the other’s lunch is kind of interesting, but sometimes that’s all people are interested in and I can see my girlfriend's reasoning for being disinterested in such discussion.
- Jonanin 2y agoExcept that many of the people involved do think of it like a football game, and thus it actually is like one. Of course the researchers and engineers at both OpenAI and Google DeepMind have a sense of rivalry and strive to one up another. They definitely feel like they are in a competition.
- TaylorAlexander 2y ago> They definitely feel like they are in a competition. Citation needed? Although I did not work in AI, I did work at Google X robotics on a robot they often use for AI research. Maybe some people felt like it was a competition, but I don’t have much reason to believe that feeling is common. AI researchers are literally in collaboration with other people in the field, publishing papers and reading the work of others to learn and build upon it.
- Jensson 2y ago
- dangoodmanUT 2y ago[flagged]
- deleted 2y ago[deleted]
- ipaddr 2y agoI can't wait to see any weights.
- arcastroe 2y ago> The shots here [..] almost all look like slow motion or slow panning shots. I think this is arguably better than the alternative. With slow-mo generated videos, you can always speed them up in editing. It's much harder to take a fast-paced video and slow it down without terrible loss in quality.
- totaldude87 2y agoCould also be the doing of google. if Veo screws up , the weight falls on Alphabet stock. While open AI is not public and doesn't have to worry about anything . Like even if open AI faked some of their AI videos(not saying they did), it wouldn't affect them the way it would affect Veo--> Google-->Alphabet being cautious often puts a dent in innovation
- soulofmischief 2y agoYou mean like how they faked some Gemini stuff? https://www.bbc.com/news/technology-67650807 https://www.bbc.com/news/technology-67650807
- latexr 2y ago> Not nearly as impressive as Sora. Sora was impressive because the clips were long and had lots of rapid movement The most impressive Sora demo was heavily edited. https://www.fxguide.com/fxfeatured/actually-using-sora/ https://www.fxguide.com/fxfeatured/actually-using-sora/
- rvz 2y agoInteresting to see that OpenAI was successful in creating their own reality distortion spells, just like Apple's reality distortion field which has fooled many of these commenters here. It's quite early to race to the conclusion that one is better than the other when not only they are both unreleased, but especially when the demos can be edited, faked or altered to look great for optics and distortion. EDIT: It appears there is at least one commenter who replied below that is upset with this fact above. It is OK to cope, but the truth really doesn't care especially when the competition (Google) came out much stronger than expected with their announcements.
- fkyoureadthedoc 2y ago[flagged]
- latexr 2y agoHN guidelines ask commenters to be kind and for the discussion to get more thoughtful and substantive as it progresses. If you believe a comment is so bad as to warrant shame and embarrassment, please explain why you think so, rather than being dismissive and spewing insults. On a related note, that is likely why you’re being downvoted. I wouldn’t be surprised if the comment is soon flagged.
- deleted 2y ago[deleted]
- ijidak 2y agoWell, as a counterpoint, Apple did become a $2 trillion dollar company... Distortion is easiest when the products really work. :)
- deleted 2y ago[deleted]
- dyauspitr 2y agoThey’re not showing people because that can get hairy quickly.
- deleted 2y ago[deleted]
- btown 2y agoA commercially available tool that can turn still images into depth-conscious panning shots is still tremendously impactful across all sorts of industries, especially tourism and hospitality. I’m really excited to see what this can do.
- pheatherlite 2y agoNot just that, but anything with a subject in it felt uncanny valleyish... like that cowboy clip, the gate of the horse stood out as odd and then I gave it some attention . It seems like a camel's gate. And whole thing seems to be hovering, gliding rather than walking. Sora indeed seems to have an advantage
- __float 2y agoI thought a camel's gait is much closer to two legs moving almost at the same time. Granted, I don't see camels often. Out of curiosity can you explain that more?