9 ms·
I disagree, just look at the legs of the woman in the first video. First she seems to be limping, than the legs rotate. The mammoth are totally uncanny for me a
by patall 3y ago
I disagree, just look at the legs of the woman in the first video. First she seems to be limping, than the legs rotate. The mammoth are totally uncanny for me as its both running and walking at the same time.
Don't get me wrong, it is impressive. But I think many people will be very uncomfortable with such motion very quickly. Same story as the fingers before.
- Hoasi 3y ago> I disagree, just look at the legs of the woman in the first video. The people behind her all walk at the same pace and seem like floating. The moving reflections, on the other hand, are impressive make-believe.
- kyrra 3y agoIf you watch the background, you'll see one guy has hits pants change color. And also, some of the guys are absolute giants compared to people around them.
- b1gnasty 3y agoReally makes me think of The Matrix scene with the woman in the red dress. Can't tell if they did this on purpose to freak us all out? Are we all just prompts?
- grotorea 3y agoI'm 99% sure this is supposed to invoke cyberpunk but not sure about The Matrix.
- lukan 3y agoYeah, it looks good at first glance. Also the fingers are still weird. And I suppose for every somewhat working vid, there were dozens of garbage. At least that was my experience with image generation. I don't believe, movie makers are out of buisness any time soon. They will have to incorporate it though. So far this can make convincing background scenery.
- Solvency 3y agoI love these hot takes based on profoundly incredible tech that literally just launched. Acting like 2030 isn't around the corner.
- bamboozled 3y agoWe’re glad you love them.
- andrepd 3y agoAnything less than absolute enrapture is a "hot take"... :)
- chefandy 3y ago> I love these hot takes based on profoundly incredible tech that literally just launched. Acting like 2030 isn't around the corner. It seems bizarre to think the gee whiz factor in a new commercial creative product makes critiquing its output out-of-bounds. This isn't a university research team: they're charging money for this. Most people have to determine if something is useful before they pay for it.
- goatlover 3y agoLet me guess, hard singularity take-off in 2030? Does the hype cycle not exist for techno-optimists? Just one breathless prediction after another?
- anoopelias 3y ago> I don't believe, movie makers are out of business any time soon My son was learning how to play keyboard and he started practicing based on metronome. At some point, I was thinking, why is he learning it at all? We can program which key to be pressed at what point in time, and then a software can play itself! Why bother? Then it hit me! Musicians could automate all the instruments with incredible accuracy since a long time. But they never do that. For some reason, they still want a person behind the piano / guitar / drums.
- 3y ago
- bamboozled 3y agoAgreed and these are the cherry picked examples of course.
- justworkout 3y agoI think a lot of these issues could be "solved" by lowering the resolution, using a low quality compression algorithm, and trimming clips down to under 10 seconds. And by solved, I mean they'll create convincing clips that'll be hard for people to dismiss unless they're really looking closely. I think it's only a matter of time until fake video clips lead to real life outrage and violence. This tech is going to be militarized before we know it.
- HlessClaudesman 3y agoYeah, we are very close to losing video as a source of truth. I showed these demos to my partner yesterday and she was upset about how real AI has become, how little we will be able to trust what we see in the future. Authoritative sources will be more valuable, but they themselves may struggle to publish only the facts and none of the fiction. Here's one possible military / political use: The commander of Russia's Black Sea Fleet, Viktor Sokolov, is widely believed to have been killed by a missile strike on 22 September 2023. https://en.wikipedia.org/wiki/Viktor_Sokolov_(naval_officer) https://en.wikipedia.org/wiki/Viktor_Sokolov_(naval_officer) Russian authorities refute his death and have released proof of life footage, which may be doctored or taken before his death. Authoritative source Wikipedia is not much help in establishing truth here, because without proof of death they must default to toeing the official line. I predict that in the coming months Sokolov (who just yesterday was removed from his post) will re-emerge in the video realm, and go on to have a glorious career. Resurrecting dead heroes is a perfect use of this tech, for states where feeding people lies is preferable to arming them with the truth. Sokolov may even go on to be the next Russian President.
- antris 3y ago> Yeah, we are very close to losing video as a source of truth. I think this way of thinking is distracted. No type of media has ever been a source of truth in itself. Videos have been edited convincingly for a long time, and people can lie about their context or cut them in a way that flips their meaning. Text is the easiest media to lie on, you can freely just make stuff up as you go, yet we don't say "we cannot trust written text anymore". Well yeah duh, you can trust no type of media just because it is formatted in a certain way. We arrive at the truth by using multiple sources and judging the sources' track records of the past. AI is not going to change how sourcing works. It might be easier to fool people who have no media literacy, but those people have always been a problem for society.
- samstave 3y ago>>>just look at the legs of the woman Denise Richards hard sharp knees in '97 -- these infant tech are already insanely good... just wait and rahter try to focus on the "what should I be betting on in 5 years from now? I suggest 'invisibility cloaks' (ghosts in machines?)
- sinuhe69 3y agoYeah. I think people nowadays are in a kind of AI-euphoria and they took every advancement in AI for more than what they really are. The realization of their limitations will set in once people have been working long enough on the stuff. The capacity of the newfangled AIs are impressive. But even more impressive are their mimicry capabilities.
- Qwero 3y agoAre you joking? We were not even able to just create random videos by just text promoting a few years back and now this. The progress is crazy. Why do you dismiss this?
- cezart 3y agoNot dismissing, but being realistic. I observed all the AI tools, usually amaze most people initially by showing capabilities never seen before. Then people realise their limitations, ie what capabilities are still missing. And they're like: "oh, this is no genie in a bottle capable of satisfying every wish. We'll still have to work to obtain our vision..." So the magic fades away, and the world returns to normal, but now with an additional tool very useful in some situations :)
- Qwero 3y agoI'm still amazed. The progress doesn't slow down right now at all. This is probably one of the most exciting developments in the world besides the Internet. And Geminis news regarding the 1 million token window shows were we are going. This will impact a lot of people faster than a lot of people realize
- attilakun 3y agoI agree. Skepticism usually serves people well as a lot of new tech turns out to be just hype. Except when it is not and I think this is one of those few cases.
- 3y ago
- anigbrowl 3y agoSame story as the fingers before. This is weird to me considering how much better this is than the SOTA still images 2 years ago. Even though there's weirdo artefacts in several of their example videos (indeed including migrating fingers), that stuff will be super easy to clean up, just as it is now for stills. And it's not going to stop improving.
- dugite-code 3y agoAnd further down the page the: "The camera follows behind a white vintage SUV with a black roof": The letters clearly wobble inconsistently. "A drone camera circles around a beautiful historic church built on a rocky outcropping along the Amalfi Coast": The woman in the white dress in the bottom left suddenly splits into multiple people like she was a single cell microbe multiplying.
- Yiin 3y agoSure, but think what it will be capable of two papers ahead :)
- csomar 3y agoProgress is this field has not been linear, though. So it's quite possible that two papers ahead we are still in the same place.
- dr_dshiv 3y agoOn the other hand, this is the first convincing use of a “diffusion transformer” [1]. My understanding is that videos and images are tokenized into patches, through a process that compresses the video/images into abstracted concepts in latent space. Those patches (image/video concepts in latent space) can then be used with transformers (because patches are the tokens). The point is that there is plenty of room for optimization following the first demonstration of a new architecture. Edit: sorry, it’s not the first diffusion transformer. That would be [2] [1] https://openai.com/research/video-generation-models-as-world-simulators https://openai.com/research/video-generation-models-as-world... [2] https://arxiv.org/abs/2212.09748 https://arxiv.org/abs/2212.09748
- koconder 3y agoHere is an explainer https://towardsdatascience.com/explaining-openai-soras-spacetime-patches-the-key-ingredient-e14e0703ec5b https://towardsdatascience.com/explaining-openai-soras-space...
- mattbrewsbytes 3y agoYep. If you look at the detail you can find obvious things wrong and these are limited to 60s in length with zero audio so I doubt full motion picture movies are going to be replaced anytime soon. B-roll background video or AI generated backgrounds for a green screen sure. I would expect any subscription to use this service when it comes out to be very expensive. At some point I have to imagine the GPU/CPU horsepower needed will outweigh the monetary costs that could be recovered. Storage costs too. Its much easier to tinker with generating text or static images in that regard. Of note: NVDA's quarterly results come out next week.
- netcan 3y ago> I think many people will be very uncomfortable with such motion very quickly So... I think OP's point stands. (impressive, surpasses human/algorithmic animation thus far). You're also right. There are "tells." But, a tell isn't a tell until we've seen it a few times. Jaron Lanier makes a point about novel technology. The first gramophone users thought it sounded identical to live orchestra. When very early films depicting a train coming towards a camera, and people fell out of their chairs... Blurry black and white, super slow frame rate projected on a bedsheet. Early 3d animation was mindblowing in the 90s. Now it seems like a marionette show. Well... I suppose there was a time when marionette shows were not campy. They probably looked magic. It seems we need some experience before we internalize the tells and it starts to look fake. My own eye for CG images seems to improving faster then the quality. We're all learning to recognize GPT generated text. I'm sure these motion captures will look more fake to us soon. That said... the fact that we're having this discussion proves that what we have here is "novel." We're looking at a breakthrough in motion/animation. Also, I'm not sure "real" is necessary. For games or film what we need is rich and believable, not real.
- Jensson 3y ago> You're also right. There are "tells." But, a tell isn't a tell until we've seen it a few times. Once you have seen a few you can tell instantly. They all move at 2 keyframes per second, that makes all movements seem alien and everything in an image moves strangely in sync. The dog moves in slow motion since they need more keyframes etc. That street some looks like they move in slow motion and others not. People will quickly learn to notice those issues, they aren't even subtle once you are aware of them, not to mention the disappearing things etc. And that wouldn't be very easy to fix, they need to train it on keyframes because training frame by frame is too much. But that should make this really easy for others to replicate. You just train on keyframes and then train a model to fill in between keyframes, and you get this. It has some limitations as we see with movement keeping the same pace in every video, but there are a lot of cool results from it anyway.
- kurthr 3y agoI have a friend who has worked on many generations of video compression over the last 20 years. He would rather watch a movie on film without effects than anything on a TV or digital theater. He's trained himself to spot defects and now even with the latest HEVC H.265 he finds it impossible to enjoy. It's artifacts all the way down and the work never ends. At the superbowl he was obsessed with blocking for fast objects, screen edge artifacts, flat field colors, and something with the grass. Luckily, I think he'll retire sooner than later, and maybe it will get better then.
- 4b11b4 3y agoThe left and right side of her face are almost... a different person.
- jstummbillig 3y ago> But I think many people will be very uncomfortable with such motion very quickly. Given the momentum in this space, I think you will have get very uncomfortable super quick about any of the shortcomings of any particular model.
- josemanuel 3y agoAt second 15, of the woman video, the legs switch sides!! Definitely there are some glitches :)