14 ms·
This is insane. But I'm impressed most of all by the quality of motion. I've quite simply never seen convincing computer-generated motion before. Just look at t
by crazygringo 3y ago
This is insane. But I'm impressed most of all by the quality of motion. I've quite simply never seen convincing computer-generated motion before. Just look at the way the wooly mammoths connect with the ground, and their lumbering mass feels real.
Motion-capture works fine because that's real motion, but every time people try to animate humans and animals, even in big-budget CGI movies, it's always ultimately obviously fake. There are so many subtle things that happen in terms of acceleration and deceleration of all of the different parts of an organism, that no animator ever gets it 100% right. No animation algorithm gets it to a point where it's believable, just where it's "less bad".
But these videos seem to be getting it entirely believable for both people and animals. Which is wild.
And then of course, not to mention that these are entirely believable 3D spaces, with seemingly full object permanence. As opposed to other efforts I've seen which are basically briefly animating a 2D scene to make it seem vaguely 3D.
- swamp40 3y agoIt's been trained on videos exclusively. Then GPT-4 interprets your prompt for it.
- deleted 3y ago[deleted]
- Sohcahtoa82 3y ago> Motion-capture works fine because that's real motion Except in games where they mo-cap at a frame rate less than what it will be rendered at and just interpolate between mo-cap samples, which makes snappy movements turn into smooth movements and motions end up in the uncanny valley. It's especially noticeable when a character is talking and makes a "P" sound. In a "P", your lips basically "pop" open. But if the motion is smoothed out, it gives the lips the look of making an "mm" sound. The lips of someone saying "post" looks like "most". At 30 fps, it's unnoticeable. At 144 fps, it's jarring once you see it and can't unsee it.
- isthispermanent 3y agoPixar is computer generated motion, no?
- minimaxir 3y agoWith extreme amounts of man-hours to do so.
- viewtransform 3y agoMain Pixar characters are all computer animated by humans. Physics effects like water, hair, clothing, smoke and background crowds use computer physics simulation but there are handles allowing an animator to direct the motion as per the directors wishes.
- gerash 3y agoWhen others create text to video systems (eg. Lumiere from Google) they publish the research (eg. https://arxiv.org/pdf/2401.12945.pdf https://arxiv.org/pdf/2401.12945.pdf). Open AI is all about commercialization. I don't like their attitude
- y_gy 3y agoIronic, isn't it! OpenAI started out "open," publishing research, and now "ClosedAI" would be a much better name.
- ionwake 3y agoTBH they should just rename to ClosedAI and run with it, I and others would appreciate the honesty plus it would be amusing.
- polygamous_bat 3y agoHowever if you are playing for the regulatory capture route (which Sam Altman seems to be angling for) it’s much easier if your name is “OpenAI”.
- efrank3 3y agogottem
- ShamelessC 3y agoSick burn!
- omega3 3y agoOut of all the examples, the wooly mammoths one actually feels like CGI the most to me, the other ones are much more believable than this one.
- mtlmtlmtlmtl 3y agoPossibly because there are no videos or even photos of live wooly mammoths, but loads and loads of CG recreations in various documentaries.
- mikeInAlaska 3y agoI saw the cat in the bed grows an extra limb...
- krapp 3y agoCats are weird sometimes.
- patall 3y agoI disagree, just look at the legs of the woman in the first video. First she seems to be limping, than the legs rotate. The mammoth are totally uncanny for me as its both running and walking at the same time. Don't get me wrong, it is impressive. But I think many people will be very uncomfortable with such motion very quickly. Same story as the fingers before.
- Hoasi 3y ago> I disagree, just look at the legs of the woman in the first video. The people behind her all walk at the same pace and seem like floating. The moving reflections, on the other hand, are impressive make-believe.
- kyrra 3y agoIf you watch the background, you'll see one guy has hits pants change color. And also, some of the guys are absolute giants compared to people around them.
- b1gnasty 3y agoReally makes me think of The Matrix scene with the woman in the red dress. Can't tell if they did this on purpose to freak us all out? Are we all just prompts?
- grotorea 3y agoI'm 99% sure this is supposed to invoke cyberpunk but not sure about The Matrix.
- lukan 3y agoYeah, it looks good at first glance. Also the fingers are still weird. And I suppose for every somewhat working vid, there were dozens of garbage. At least that was my experience with image generation. I don't believe, movie makers are out of buisness any time soon. They will have to incorporate it though. So far this can make convincing background scenery.
- djmips 3y agoI'm not sure I feel the same way about the mammoths - and the billowing snow makes no sense as someone who grew up in a snowy area. If the snow was powder maybe but that's not what's depicted on the ground.
- bamboozled 3y agoI’m a bit thrown off by the fact the mammoths are steaming, is that normal for mammoths ?
- throw310822 3y agoGood question :)
- geor9e 3y agoIt's possible that through sheer volume of training, the neural network essentially has a 3D engine going on, or at least picked up enough of the rules of light and shape and physics to look the same as unreal or unity
- samsullivan 3y agoIt would have to in order to produce the outputs, our brains have crazy physics engines though, F1 drivers can simulate an entire race in their heads.
- staticautomatic 3y agoI wonder if they could theoretically race multiple people at once like chess masters.
- colordrops 3y agoYou might just be subject to confirmation bias here. Perhaps there were scenes and entities you didn't realize were CGI due to high quality animation, and thus didn't account for them in your assessment.
- samstave 3y agoSerious: Can one just pipe an SRT (subtitle file) and then tell it to compare its version to the mp4 and then be able to command it to zoom, enhance, edit, and basically use it to remould content. I think this sounds great!
- windowshopping 3y agoHuh, strong disagree. I've seen realistic CGI motion many times and I don't consider this to feel realistic at all.
- lastdong 3y agoRegarding CGI, I think it has became so good that you don’t know it’s CGI. Look at the dog in Guardians of the Galaxy 3. There’s a whole series on YouTube called “no cgi is really just invisible cgi” that I recommend watching. And as with cgi, models like SORA will get better until you can’t tell reality apart. It's not there Yet, but an immense astonishingly breakthrough.
- unsigner 3y agoDon't think of them as "computer-generated" any more than your phone's heavily processed pictures are "computer-generated", or JWST's false color, IR-to-visible pictures are "computer-generated". This article makes a convincing argument: https://studio.ribbonfarm.com/p/a-camera-not-an-engine https://studio.ribbonfarm.com/p/a-camera-not-an-engine
- lynguist 3y agoThat is such a gem of an article that looks at AI with a new lens I haven’t encountered before: - AI sees and doesn’t generate - It is dual to economics that pretends to describe but actually generates
- globular-toast 3y agoNah this still has the problem with connecting surfaces that never seems to look right in any CGI. It's actually interesting that it doesn't look right here as well considering they are completely different techniques.
- kitd 3y agoMaybe it's my anthropocentric brain, but the animals move realistically while the people still look quite off. It's still an unbelievable achievement though. I love the paper seahorse whose tail is made (realistically) using the paper folds.
- belter 3y agoJust setup a family password last week...Now it seems every member of the family will have to become their own certificate authority and carry an MFA device. "Worried About AI Voice Clone Scams? Create a Family Password" - https://www.eff.org/deeplinks/2024/01/worried-about-ai-voice-clone-scams-create-family-password https://www.eff.org/deeplinks/2024/01/worried-about-ai-voice...
- kaba0 3y ago> I've quite simply never seen convincing computer-generated motion before I’m fairly sure you have seen it many times, it was just so convincing that you didn’t realize it was CGI. It’s a fundamentally biased way to sample it, as you won’t see examples of well executed stuff.