54 ms·

Meta Movie Gen

• bitbasher 2y ago
  If social media was the scourge of the last decade, the next decade's scourge will be artificial content. Digital minimalism is looking more and more attractive.
  • bamboozled 2y ago
    Sitting in my workshop drinking a cup of tea on a break from making some new saw horses and reading these comments. I’m just so grateful I can do something with my hands, I’m delighted, couldn’t be happier. If the world ends tomorrow. I’m ok so long as I’m not wasting it on Instagram shit post filled with fake content when it goes down.
• greybox 2y ago
  At what point did someone look at this and think: "Ah yes, this will be good for humanity right now" ?
  • oblio 2y ago
    That person would have been fired :-(
  • afh1 2y ago
    Seems to have great potential in the VFX industry, for one thing.
  • tim333 2y ago
    I don't think it works like that. It's more "Hey! This tech can make funky videos"
• 39896880 2y ago
  They all have dead eyes. It's creepy.
• msp26 2y ago
  Any chance of this being released open weights? Or is the risk of bad PR too high (especially near a US election)? It being 30B gives me hope.
  • thawab 2y ago
    Meta text to image model cm3leon[0], was announced july 2023. It wasn't released yet, I think this one might take a while. [0] https://ai.meta.com/blog/generative-ai-text-images-cm3leon/ https://ai.meta.com/blog/generative-ai-text-images-cm3leon/
    • KolmogorovComp 2y ago
      I don't think they will ever release it considering it's likely much worse than flux.
  • diggan 2y ago
    > Any chance of this being released open weights? Considering that Facebook/Meta releases blog posts titled "Open Source AI Is the Path Forward" but then refuses to actually release any Open Source AI, I'm guessing the answer is a hard "No". They might release it under usage restrictions though, like they did with Llama, although probably only the smaller versions, to limit the output quality.
    • causal 2y ago
      They have released a ton of open source? Llama 3 includes open training code, datasets, and models. Not to mention open-sourcing the foundation of most AI research today, pytorch.
      • diggan 2y ago
        Llama 3 is licensed under "Llama 3 Community License Agreement" which includes restrictions on usage, clearly not "Open Source" as we traditionally know it. Just because pytorch is Open Source doesn't mean everything Meta AI releases is Open Source, not sure how that would make sense. Datasets for Llama 3 is "A new mix of publicly available online data.", not exactly open or even very descriptive. That could be anything. And no, the training code for Llama 3 isn't available, response from a Meta employee was: "However, at the moment-we haven't open sourced the pre-training scripts".
• brianjking 2y ago
  Additional Links: https://x.com/AIatMeta/status/1842188252541043075 https://x.com/AIatMeta/status/1842188252541043075 https://ai.meta.com/static-resource/movie-gen-research-paper https://ai.meta.com/static-resource/movie-gen-research-paper From Twitter/X: Today we’re premiering Meta Movie Gen: the most advanced media foundation models to-date. Developed by AI research teams at Meta, Movie Gen delivers state-of-the-art results across a range of capabilities. We’re excited for the potential of this line of research to usher in entirely new possibilities for casual creators and creative professionals alike. More details and examples of what Movie Gen can do https://go.fb.me/kx1nqm https://go.fb.me/kx1nqm Movie Gen models and capabilities Movie Gen Video: 30B parameter transformer model that can generate high-quality and high-definition images and videos from a single text prompt. Movie Gen Audio: A 13B parameter transformer model that can take a video input along with optional text prompts for controllability to generate high-fidelity audio synced to the video. It can generate ambient sound, instrumental background music and foley sound — delivering state-of-the-art results in audio quality, video-to-audio alignment and text-to-audio alignment. Precise video editing: Using a generated or existing video and accompanying text instructions as an input it can perform localized edits such as adding, removing or replacing elements — or global changes like background or style changes. Personalized videos: Using an image of a person and a text prompt, the model can generate a video with state-of-the-art results on character preservation and natural movement in video. We’re continuing to work closely with creative professionals from across the field to integrate their feedback as we work towards a potential release. We look forward to sharing more on this work and the creative possibilities it will enable in the future.
  • deleted 2y ago
    [deleted]
• happyraul 2y ago
  Hippos can't actually swim though.
  • aimazon 2y ago
    [flagged]
  • deleted 2y ago
    [deleted]
  • diggan 2y ago
    Was my first reaction too when seeing the video at the top. But then after thinking about it, it makes sense as an example, you want to showcase things that aren't real but look realistic. A hippo swimming looks real, but it isn't as they don't swim.
  • elpocko 2y ago
    I have watched some films recently, and they are full of weird mistakes. A bunch of balloons can't lift your house into the air. DeLoreans can't actually travel through time. Gamma rays don't give you superhuman strength. A 6502 CPU couldn't power an advanced AI for killer robots from the future. So unrealistic.
  • awfulneutral 2y ago
    Haha, this is the first thing I thought of too. I knew adult hippos walk on the bottom, but from looking at existing videos it looks like small (baby/pygmy) hippos do too, they don't float at the surface like this.
• TrackerFF 2y ago
  All the vids have that instantly recognizable GenAI "sheen", for the lack of a better word. Also, I think the most obvious giveaway are all the micro-variations that happen along the edges, which give a fuzzy artifact.
  • Rinzler89 2y ago
    >All the vids have that instantly recognizable GenAI "sheen" That's something that can be fixed in a future release or you can fix it right now with some filters in post in your pipeline.
    • surfingdino 2y ago
      > "That's something that can be easily fixed in a future release (...)" This has been the default excuse for the last 5+ years. I won't hold my breath.
      • ekianjo 2y ago
        You had AI videos 5 years ago?
        • surfingdino 2y ago
          AI in general.
          • bbor 2y ago
            …I mean, it was advancing slowly for linguistic tasks until late 2022, that’s fair. That’s why we’re in such a crazy unexpected rollercoaster of an era - we accidentally cracked intuitive computing while trying to build the best text autocomplete. AI in general is from 1950, or more generally from whenever the abacus was invented. This very website runs on AI, and always has. I would implore us to speak more exactly if we’re criticizing stuff; “LLMs” came around (in force) in 2023, both for coherent language use (ChatGPT 3.5) and image use (DALLE2). The predecessors were an order of magnitude less capable, and going back 5 years puts us back in the era of “chatbots”, aka dumb toys that can barely string together a Reddit comment on /r/subredditsimulator.
• jsheard 2y ago
  If nothing else it will produce some amazing material for this account, once the content farms get their hands on it: https://x.com/FacebookAIslop https://x.com/FacebookAIslop
  • deleted 2y ago
    [deleted]
• niles 2y ago
  Crashes Firefox mobile. Looks pretty impressive on Chrome! Apparently hosted only
  • deleted 2y ago
    [deleted]
• lwansbrough 2y ago
  This is really something. The spatial and temporal coherence is unbelievable.
• dartharva 2y ago
  [flagged]
  • deleted 2y ago
    [deleted]
• sourraspberry 2y ago
  Impressive. Always important to bear in mind that the examples they show are likely the best examples they were able to produce. Many times over the past few years a new AI release has "wowed" me, but none of them resulted in any sudden overnight changes to the world as we know it. VFX artists: You can sleep well tonight, just keep an eye on things!
  • bbor 2y ago
    Tbf, the biggest private infrastructure project in the history of humanity is now underway (Microsoft GPU centers), the fastest app to reach #1 on the App Store was released (ChatGPT), and it’s dominating online discourse. Many companies have used LLMs to justify layoffs, and /r/writers and many, many fanart subreddits already talk of significant changes to their niches. All of this was basically at 0 in 2022, and 100 by early 2023. It’s not normal. Everyone should sleep well tonight, but only because we’ll look out for each other and fight for just distribution of resources, not because the current job market is stable. IMO :)
    • 123yawaworht456 2y ago
      >Many companies have used LLMs to justify layoffs they are not allowed to call the recession a recession until January 20
  • chucky_z 2y ago
    VFX artists cannot sleep well, they're already being displaced with AI or being forced to use it to massively increase their output. Here's an example thread: https://www.reddit.com/r/vfx/comments/1e4zdj7/in_the_climate_of_ai_and_strikes_should_i_become/ https://www.reddit.com/r/vfx/comments/1e4zdj7/in_the_climate... I am not trying to be negative, however it is the reality that ML/LLM has eliminated entire industries. Medical transcription for example is essentially gone.
    • sionisrecur 2y ago
      I don't see it as that much of a problem. It's like washing machines taking away people's job of washing clothes, what are they gonna do with their time now? Maybe something more productive.
• syntaxing 2y ago
  I find the edit video with text the most fascinating aspect. I can see this being used for indie films that doesn’t have a CGI budget. Like the scene with the movie theater, you can film them on lounge chairs first and then edit it to seem like a movie theater.
  • ForHackernews 2y ago
    Why bother? Actors cost money and scheduling is difficult. Do the whole thing in AI - the model will be trained on better actors than your indie cast, anyway.
    • M4v3R 2y ago
      It will be a loong time before AI can produce lead actors that are believable, act exactly the way you as a director want and tell the story you want to tell, so I think at least for now you'll still need the actors for the lead roles. But I can totally this being used for generating people/stuff in the background of certain shots in a low budget movie.
      • ipaddr 2y ago
        Isn't that a core problem now. Getting actors to act exactly how you want was never a solved problem. But this limits promotion where actors do interviews and sell the movie to the public. It also limits an actor doing something crazy that tanks a movie like a tweet.
        • l33tbro 2y ago
          The answer is that it depends on the director. For David Fincher or the Coen brothers, having this level of exactitude and precision is what their craft is all about. But for plenty of other masters - think Cassavetes, Mike Leigh, even PTA - the actor's outstanding talent and instincts bring something to the script and vision that is outside of their prescriptive powers. Their focus is essentially setting up a framework for magic to happen inside of.
        • 2y ago
• quest88 2y ago
  That's very impressive.
• Jean-Papoulos 2y ago
  Website doesn't work on Firefox and videos don't play on Edge. They should consider asking the AI to make a correct website before having it make hippos swim.
  • loufe 2y ago
    The entire page load is completely broken on Edge for me. Bizarre
    • littlestymaar 2y ago
      It works fine for me on Firefox on Linux, weird.
      • adrian_b 2y ago
        Also Firefox 127.0.1 on Linux, works perfectly (using an NVIDIA GPU).
        • chinathrow 2y ago
          That's a bit old, isn't it?
          • adrian_b 2y ago
            It is only a little more than 3 months old, so I would not call that old. I avoid updating to each new Firefox version, because from time to time they break some features important for me.
    • aphit 2y ago
      All works fine for me here in Edge, odd.
  • bob1029 2y ago
    Not working in Safari on my MBP either.
  • 2y ago
• voidUpdate 2y ago
  Some of these look really obviously bad, like the guy spinning the fire and the girl running along the beach. And it completely failed at the bubbles
  • Quarrelsome 2y ago
    doesn't need to be movie quality, just needs to be tiktok quality and this totally passes the bar. Are you ready to become a penguin in all of your posts to maximise aquatic engagement? I am.
    • voidUpdate 2y ago
      I've become a robot and a demon to maximise engagement, its called being a vtuber
  • nsagent 2y ago
    Interesting perspective, considering a paper ByteDance just released yesterday [1] has much worse video quality. If your comparison is to real videos, then for sure the quality isn't great. If instead you compare to other released research, the this model is one of the best released thus far. [1]: https://epiphqny.github.io/Loong-video/ https://epiphqny.github.io/Loong-video/
    • add-sub-mul-div 2y ago
      Okay, let's give it a participation trophy for being the best of the slop category.
  • beezlebroxxxxxx 2y ago
    Yeah, some were impressive, but others looked quite bad. The guy running in the desert looked like a guy floating over the ground only sporadically making contact with the sand. The footfalls in a lot of these videos look pretty janky or "soft". The clothing changes also have pretty rough edges, or just look like they're floating over the original model. The 3D glasses one looked atrocious. The lighting changes are also pretty lacking.
• cs702 2y ago
  Impressive. It's only going to get better, faster, cheaper, easier.[a] Sooner than anyone could have expected, we'll be able to ask the machines: "Turn this book into a two-hour movie with the likeness of [your favorite actor/actress] in the lead role." Sooner than anyone could have expected, we'll be able to have immersive VR experiences that are crafted to each person. Sooner than anyone could have expected, we won't be able to identify deepfakes anymore. We sure live in interesting times! --- [a] With apologies to Daft Punk: https://www.youtube.com/watch?v=gAjR4_CbPpQ https://www.youtube.com/watch?v=gAjR4_CbPpQ
  • kingofthehill98 2y ago
    But mostly just porn.
    • spacebanana7 2y ago
      I think AI porn is overhyped. We've had the ability to create realistic photos and short vids for over a year now and onlyfans creators are still doing fine. AI porn is just a niche for stuff that humans don't want to perform.
      • candiddevmike 2y ago
        I think AI porn is chocked full of fascinating moral quandaries. It kind of transcends all other types of GenAI for the amount of hard questions it asks society. As they say, porn is always the leading spear of technology. It's something to keep an eye on (no pun intended) to understand how society will accept/integrate generated content.
        • spacebanana7 2y ago
          It's definitely interesting from a moral and tech perspective. However, commercially it seems like a niche within the existing structures of porn. Mostly competing with the market for animated stuff. At least that's where it is right now, and its already at photorealistic parity with human content creators.
• indymike 2y ago
  The giant crab-like thing in the background of the Hippo swimming (if a hippo could swim) is the stuff of nightmares.
• bbor 2y ago
  Incredible, simply incredible. You know a paper is seminal when all the methods seem obvious in hindsight! Though I’m not caught up on SOTA, so maybe some of this is obvious in normal-sight, too. RIP Pika and ElevenLabs… tho I guess they always can offer convenience and top tier UX. Still, gotta imagine they’re panicking this morning! Upload an image of yourself and transform it into a personalized video. Movie Gen’s cutting-edge model lets you create personalized videos that preserve human identity and motion. Given how effective the still images of Trump saving people in floodwater and fixing electrical poles have been despite being identifiable as AI if you look closely (or think…), this is going to be nuts. 16 seconds is more than enough to convince people, I’m guessing the average video watch time is much less than that on social media. Also, YouTube shorts (and whatever Meta’s version is) is about to get even worse, yet also probably more addicting! It would be hard to explain to an alien why we got so unreasonably good at optimal content to keep people scrolling. Imagine an automated YouTube channel running 24/7 A/B experiments for some set of audiences…
• nanna 2y ago
  Absolutely terrifying. Please stop.
  • vouaobrasil 2y ago
    Absolutely agree. It's very terrifying and will likely cause mass disruption because it will disintegrate the social fabric that is held together by people needing other people for stuff.
    • Sgt_Apone 2y ago
      Absolutely. What's even the purpose of this thing? Who is it really serving?
    • thriwster 2y ago
      It is also an automated loom. But now we techno creatives are the luddites.
      • sensanaty 2y ago
        The luddites wanted sane working conditions and to be trained on the use of newly introduced, dangerous machinery that was maiming and killing people and was meant to replace swathes of them overnight to make some rich capitalists richer. The end result for them wanting humane conditions was getting murdered by the machine owners & the state. Perhaps the rabidly pro-AI people shouldn't be on the side of the murderous psychopaths who wanted to extract maximum profit by employing children and displacing thousands of people if they don't want to be viewed as similarly psychotic.
• clvx 2y ago
  Off topic but some day you could live off grid with your own solar fusion mini reactor powering your own hardware that enables creating your own stories, movies and tales. No more need of streaming services. Internet would be to obtain news, goods and buy greatest and latest (or not) data to update your models. Decentralization could be for once not as painful as it is now; however, I still believe every single hardware vendor would try to hook to the internet and make you install an app. Looking forward to this AI revolution for sure.
  • adamc 2y ago
    I'm not. The likelihood that such movies (for example) would have anything significant to say about being human seems very low. If one watches movies, reads books, etc. just to pass the time, maybe this would be some kind of boon. But for those of us looking for meaningful commentary on life, looking to connect with other human beings, this would be some circle of hell. It's some kind of solipsism.
    • CuriouslyC 2y ago
      That doesn't follow at all. If I come up with a meaningful story and use AI to generate clips and stich them together to tell it, that's real art. If you disagree with that, you're basically saying La Jetee isn't art, which would be a hard sell.
      • adamc 2y ago
        I don't have anything against stitching together clips to tell your story, but I'm unconvinced that these demonstrate anything like that. As I said in another comment, it seems like you'd need to write a screenplay PLUS all the information the director, cinematographer, etc. use to create an actual movie -- everything from direction for how actors portray scenes to decisions on exactly how shots are constructed, to blocking for multiple actors in a scene, to color schemes... There are a LOT of choices in making a movie, and if you just let the AI make them, you are getting "random" (uncontrolled) choices. I don't think that is going to compare favorably to the real thing. If you can specify all that, then it's just a tool. Cool. But it's still going to take pro-level skills to use it.
• codeduck 2y ago
  those penguins are incredibly buoyant.
• thinkingemote 2y ago
  Are any image / video generation tools giving just the output or the layers, timelines, transitions, audio as things to work with in our old fashioned toolsets? The problem: In my limited playing of these tools they don't quite make the mark and I would easily be able to tweak something if I had all the layers used. I imagine in the future products could be used to tweak this to match what I think the output should be.... At least the code generation tools are providing source code. Imagine them only giving compiled bytecode.
  • swatcoder 2y ago
    Keep in mind that these technologies produce more stuff like what they've been trained on, and they need tremendous amounts of training data to pull that off. It so happens that there are innumerable samples of prose and source code and rendered songs and videos and images to use as this training data. But that's not so much the case for professional workflows (outside of software development). If the tools can evolve to generating usefully detailed and coherent media projects instead of just perceptually convincing media assets, it's going to be a while before they get there.
  • botanical76 2y ago
    They definitely do not give you an Adobe After Effects project. This is because of the way they are trained. I suspect a vast proportion of its training data is not annotated with the corresponding layers, timelines, etc so the model is unable to reproduce it like that. You basically just get video AFAIK.
  • vunderba 2y ago
    If you have experience as a graphic designer, you can get very far with any layer based graphic tools like Krita or Affinity in conjunction with proper inpainting against generative image models - in fact that's InvokeAI's entire target user base.
  • woodson 2y ago
    There are some approaches that use an LLM to generate “scripts” (you can think of them as a DSL) for composing/arranging media, essentially driving other models to generate parts of the media. One example is WavJourney: https://audio-agi.github.io/WavJourney_demopage/ https://audio-agi.github.io/WavJourney_demopage/
• tempusalaria 2y ago
  We live in the future. I just hope we consumers get easy access to these video tools at some point. I want to make personal movies from my favorite books
• HumblyTossed 2y ago
  I'm not impressed with the quality. Did they mean to make it look so cartoony?
  • brokensegue 2y ago
    A lot of them don't look cartoony to me. Better then previous video generators
• Hard_Space 2y ago
  Yet another one-shot, single-clip Instagram machine that can't do a follow-on shot natively. As it stands, the only chance you have of depicting a consistent story across a series of shots is image-to-video, presuming you can use LoRAs or similar techniques to get the seed photos consistent in themselves.
• skerit 2y ago
  I made a silly 1-hour long movie with friends +/- 20 years ago, on DV tape. I would love to use this to actually be able to implement all the things we wanted to achieve back then
• tikkun 2y ago
  FAQs I found: Is it available for use now? Nope When will it be available for use? On FB, IG and WhatsApp in 2025 Will it be open sourced? Maybe What are they doing before releasing it? Working with filmmakers, improving video quality, reducing inference time
• kleiba 2y ago
  To all the folks with negative opinions of this work: you guys are nuts! This work is incredible. Is it the end of the line yet? Of course not, but come on! This is unbelievably cool, and who of you would have predicted any of this ten years ago?
  • KevinGlass 2y ago
    It's incredible in the same way an AK-47 is incredible. This sort of thing is going to uproot all of culture and god knows what happens after that.
  • vouaobrasil 2y ago
    For me, peace in society, a nice world where humans can share what they create, and nature outside and preserved are all much better than "cool", and this "cool" tool threatens all of the above.
  • deleted 2y ago
    [deleted]
• wiseowise 2y ago
  So I’m probably going to be too closed minded about this: but who the f*ck asked for this and did anyone consider consequences of easily accessible AI slop generation? It’s already nearly impossible to find quality content on the internet if you don’t know where to look at.
  • tiborsaas 2y ago
    I did and I'm quite happy that this is happening :) It's unleashing a new computing era when you just have to lean back, close your eyes and your vision can materialize without a Hollywood production crew.
    • NexRebular 2y ago
      And it's great as anyone can use it in whichever way they want since machine generated content does not have copyright protections. We will finally achieve the dream of everything being in public domain!
  • oblio 2y ago
    It's only going to be worse and aggregators aka gatekeepers will increase in value immensely.
  • OrangeMusic 2y ago
    > who the f*ck asked for this Have you heard of the quip "Because we can"?
• nthdesign 2y ago
  My kids both have creative hearts, and they are terrified that A.I. will prevent them from earning a living through creativity. Very recently, I've had an alternate thought. We've spent decades improving the technology of entertainment, spending billions (trillions?) of dollars in the process. When A.I. can generate any entertainment you can imagine, we might start finding this kind of entertainment boring. Maybe, at that point, we decide that exploring space, stretching our knowledge of physics and chemistry, and combating disease are far more interesting because they are real. And, through the same lens, maybe human-created art is more interesting because it is real.
  • solaris152000 2y ago
    I had a similar thought. I knew someone who lived a life of crime, for a long time he was very poor like most criminals, but for a while made it big. He could buy anything he wanted, he always liked suits so bought very nice suits. But they meant nothing to him, he couldn't enjoy them, as he didn't earn then. I wonder if it will be the same with AI. When you can have anything for nothing, it has no value. So the digital world will have little meaning.
    • 2OEH8eoCRo0 2y ago
      That's my optimistic belief as well but I've also been disappointed at every turn. The future feels like a nihilistic joke constantly competing to plot the most disappointing course forward. More likely the average person will happily lap up AI generated slop.
      • deleted 2y ago
        [deleted]
    • dyauspitr 2y ago
      He might be an exception because most people would have no problems riding around in a million dollar car whether they earned it or not.
      • 2y ago
• sroerick 2y ago
  I haven’t had any luck being able to effectively generate compositions with text to image / text to video. Prompts like “subject in the lower third of the frame” have thus far completely failed me. I’m sure this will change in the future but this seems pretty fundamental for any ‘AI Powered Film’ to function the way a film director would. Curious if anybody has a solution or if this works for that
• Animats 2y ago
  Likely results: - Every script in Hollywood will now be submitted with a previs movie. - Manga to anime converters. - Online commercials for far more products.
  • sroussey 2y ago
    Scripts with AI low quality “movie” with blocking etc is an interesting concept. Manga to anime already exists. Commercials, particularly for social/online, already happening as well.
  • danielbln 2y ago
    Previsband storyboarding will benefit tremendously from this, though ultimately it will be usable for B-roll or second unit stuff. And then? We'll see if this tech levels out or up.
• wseqyrku 2y ago
  Looking at bolt.new I think all the Studio/IDE type of apps are going to look like that. Could be video or code or docs etc. I can see myself paying a little too much to have a local setup for this.
• jcims 2y ago
  One thing I've noticed with the set of music generation tools (eg Udio, Suno) is that there's a sort of profound attachment to songs that you create. I've never made music the old fashioned way so I'm guessing the same could be true for that as well, but there are songs I've made on Udio that I personally think are amazing but nobody else really responds to. Conversely I can see similar levels of pride and attachment from others for songs they have created that don't do anything for me. It's going to be interesting to see how that plays out when you can make just about any kind of media you wish. (Especially when you can mix this as a form of 'embodiment' to realize relationships with virtual agents operated by LLMs.)
  • SamBorick 2y ago
    > I've never made music the old fashioned way so I'm guessing the same could be true for that as well Yes, it is. You should try it.
    • grepfru_it 2y ago
      It’s the same feeling. No different from rebuilding that crazy synth you made one night, succeeding, and then being able to improv/vamp with it during a live session. It is a creative process and I urge anyone who finds the high level aspect of music creation to pursue the lower levels
  • corytheboyd 2y ago
    > I personally think are amazing but nobody else really responds to. Welcome to making music lol. Since there is so much of it, you have to make the absolute best to even be considered. And then, because so many people make the absolute best, people only care about the persona making the music (as great as you are, you aren’t Taylor Swift, Kendrick Lamar, Damon Albarn). Your friends will never care about your music just because you are friends, don’t fall into that trap. Also nobody cares about music without good lyrics, because again, there is just so much instrumental content out there that sounds the same, lyrics differentiate it with a human, emotional element. Just make stuff for fun. Listen to it every now and then and feel the magic of “hehe I made that”
• dpcan 2y ago
  You know it’s going to happen: “I want a funny road trip movie staring Jim Carey and Chris Farley, based in Europe, in the fall, where they have to rescue their mom played by Lucille ball from making the mistake of marrying a character played by an older Steve Martin.” 10 minutes later your movie is generated. If you like it, you save it, share it, etc. You have a queue of movies shared by your friends that they liked. Content will be endless and generated.
  • adventured 2y ago
    It'll require tens to hundreds of hours to script the flow of the AI content, to edit, make adjustments, clean it up, make the scenes link together smoothly, fix small glitches. Even with far more advanced AI, it won't come together like a movie people would enjoy watching, without vast human labor involved. Sub one percent of people are going to be willing to put in the hours to do it. The bulk of the spammed created content will be: the masses very briefly playing with the generative capabilities, producing low quality garbage that after five minutes nobody is interested in and then the masses will move on to the next thing to occupy a moment of their time. See: generative image media today. So few people care about the crazy image creation abilities of MidJourney or Flux, that you'd think it didn't exist at all (other than the occasional related headline about deepfakes and or politics).
    • halyax7 2y ago
      Much of those editing steps could be streamlined and/or straight up automated so that estimate will come way down over time
  • candiddevmike 2y ago
    The content bubble apocalypse, where no one is ever watching the same thing and we lose all cultural connections to each other. At least until someone figures out an algorithm/prompt to influence the content, yvan eht nioj style.
    • adventured 2y ago
• oulipo 2y ago
  Impressive, yet more burning GPUs and pushing CO2 in the atmosphere just for stupid stuff that is only of interest to rich western people... I'd rather have those people work on climate change solutions
  • dyauspitr 2y ago
    No thank you, I not going to let my beloved progressives be dragged into Luddism just so you can feel a little better about yourself through insignificant changes without a meaningful impact on the environment. Anything with true lasting effects will have to be top down like renewable resources/energy, EVs, viable alternatives to plastic, nuclear energy etc. The argument should never be about reducing energy usage, rather it should be about how we generate that energy in a clean, renewable way.
  • dievskiy 2y ago
    > Impressive, yet more burning GPUs and pushing CO2 in the atmosphere just for stupid stuff that is only of interest to rich western people Better to spend 10x amount of energy on humans that will give the same result?
  • throwaway38543 2y ago
    [flagged]
  • Bloedcoins 2y ago
    At least companies are behind it which can actually put the money were its needed and compensate it. At least microsoft and google are on a co2 neutral race. And all of these clusters doing something can also do research and partially do. Its valid critisism, but we need to stop co2 production on a lot of other industries before we do that for datacenters. Datacenters save a lot more co2 (just think about not having to drive to a bank to do bank business).
  • kkielhofner 2y ago
    > burning GPUs and pushing CO2 in the atmosphere My startup develops AI for the nuclear power industry to drive process, documentation, and regulatory efficiency. We like to say "AI needs nuclear and nuclear needs AI". Big tech has finally realized/gone public that casually saying things like "we're building our next 1GW datacenter" is uhh, problematic[0]. For some time now there has been significant interest/activity in wiring up entire datacenters to nuclear reactors (existing Gen 2, SMRs, etc): https://finance.yahoo.com/news/nvidia-huang-says-nuclear-power-171024058.html https://finance.yahoo.com/news/nvidia-huang-says-nuclear-pow... https://www.ans.org/news/article-5842/amazon-buys-nuclearpowered-data-center-from-talen/ https://www.ans.org/news/article-5842/amazon-buys-nuclearpow... https://www.yahoo.com/news/microsoft-signs-groundbreaking-energy-deal-103018707.html https://www.yahoo.com/news/microsoft-signs-groundbreaking-en... https://www.cnbc.com/2024/09/10/oracle-is-designing-a-data-center-that-would-be-powered-by-three-small-nuclear-reactors.html https://www.cnbc.com/2024/09/10/oracle-is-designing-a-data-c... https://thehill.com/policy/technology/4913714-google-ceo-eyeing-electricity-from-nuclear-plants-for-its-data-centers/ https://thehill.com/policy/technology/4913714-google-ceo-eye... [0] - https://www.npr.org/2024/07/12/g-s1-9545/ai-brings-soaring-emissions-for-google-and-microsoft-a-major-contributor-to-climate-change https://www.npr.org/2024/07/12/g-s1-9545/ai-brings-soaring-e...
• joshdavham 2y ago
  I wonder if one day we’ll have generative recommender systems where, instead of finding videos the algorithm thinks you’ll like, it just generates them on the spot.
• turblety 2y ago
  Why do these video generation ones never become usable to the public. Is it just they had to create millions of videos and cherry pick only a handful of decent generations? Or is it just so expensive there's no business model for it? My mind instantly assumes it a money thing and they're just wanting to charge millions for it, therefore out of reach for the general public. But then with Meta's whole stance on open ai models, that doesn't seem to ring true.
  • FileSorter 2y ago
    There are usable ones runwayml.com pika.art hailuoai.com
    • grumbel 2y ago
      klingai.com lumalabs.ai
      • Apocryphon 2y ago
        When I see lists of URLs like that I can only wonder what a future post archeologist, coming upon this long dusty thread half a decade from now, will find when they try to go to those sites.
  • causal 2y ago
    I'd guess 1 in 10 model demos turn out to be useful product, at best. This and Sora are particularly annoying, though, for how they put together these huge flashy showcases like they're announcing some kind of product launch and then... nothing. Apparently there's value in just flexing your AI-making muscle now and then.
    • 93po 2y ago
      to be fair, Sora was one of the most mind blowing technology showcases of my life, and openai is successful at raising tons of money
    • dangsux 2y ago
• nephy 2y ago
  McDonald’s art.
• deng 2y ago
  These are not movies, these are clips. The stock photo/clip industry is surely worried about this, and probably will sue because 100% these models were trained on their work. If this technology ever makes movies, it'll be exactly like all the texts, images and music these models create: an average of everything ever created, so incredibly mediocre.
  • sethammons 2y ago
    I imagine a movie maker where you say "use model A and put them in scene 32f, add a crowd and zoom in on A. They should look very worried." Then they can just play with it. Then save a scene, onto the next. Since AI can continue an animation, I don't see why it can't faithfully recreate given models with more development
  • jkolio 2y ago
    There have been several AI short film festivals, as well as several AI music videos that have been produced. The caveats are that quality varies, the best ones simply employ solid production in general (good editing, strong directorial vision, etc), and I don't know that anything feature length is out or even in the works.
  • DirkH 2y ago
    What'll happen in both industries is the same that will happen everywhere else: adopt or die. The huge winners will be those that creatively use this new tool without 100% relying on it to do everything.
  • spaceman_2020 2y ago
    the problem is that these stock footage companies are up against the richest corporations to ever exist. Legal recourse will take a monumental amount of money and time. Hate to say this, but as things stand, tech companies stand to become all pervasive and all powerful if AI keeps growing the way it has
• devonsolomon 2y ago
  I’ve long ago heard it said that the two drivers of technology innovation are the military and porn. And, welp, I don’t see any use of this to the military.
• deleted 2y ago
  [deleted]
• Krei-se 2y ago
  This is totally awesome - the tech is out there and whether you use it to make videos or solve long human / world problems is up to you. Yeah, we might get the bad killer robots. But it's more likely this will make it unnecessary to wonder where on this blue planet you can still live when we power the deserts with solar and go to space. Getting clean nutrition and environment will be within reach. I think that's great. As with all technology: Yes a car is faster than you. And you can buy or rent one. But it's still great to be healthy and able to jog. So keep your brains folks and get some skills :)
  • whiplash451 2y ago
    « out there » is slightly optimistic. The model is not released and probably won’t be for a while. And it probably costs Meta-scale infra to fine-tune to your needs.
• idunnoman1222 2y ago
  It will be as interesting as our dreams. So maybe personally interesting, like for a small group sitting around a table and taking the piss. But it’s not gonna make a global sensation.
• Jiahang 2y ago
  student here ，i learn cs and management. And i really Puzzled what i learn now can help me have better life in this era of rapid development of technology.
• karel-3d 2y ago
  Why don't videos like this ever trend? #cabincrew #scarletjohanson #amen
• 999900000999 2y ago
  Very cool. But I'm worried about this tech being used for propaganda and dis information. Someone with a 1K computer and enough effort can generate a video that looks real enough. Add some effects to make it look like it was captured by a CCTV or another low res camera. This is what we know about, who knows what's behind NDAs or security clearances.
  • nuz 2y ago
    Same was thought to happen about images but it hasn't. People quickly debunk AI generated content presented as real in replies or community notes. Not a real issue.
    • 999900000999 2y ago
      Maybe maybe not. As is simple false journalism has caused issues on Facebook in certain countries ( to put it lightly). It's only going to look more realistic in time...
• dangsucksdick1 2y ago
  [dead]
• FrequentLurker 2y ago
  They didn't post any examples where it fails?
• smusamashah 2y ago
  I was looking for that landslide effect (as seen even in Sora and Kling) where land seems moving very disproportionally to everything else. It makes me motion sick. I have not seen those Sora demo videos a second time for that reason. These are smooth, consistent, no landslide (except sloth floating in water, the stones on right are moving at much higher rate than the dock coming closer), no things appearing out of nowhere. Editing seems not as high quality (the candle to bubble example). To me, these didn't induce nausea while being very high quality makes it best among current video generators.
• pookha 2y ago
  Facebook just spent 40 billion dollars on their AI infrastructure. Can they recoup those costs with stuff like this (especially after the VI debacle)? I doubt it. AI has been a wild ass jagged wasteland of economic failure since the 1950's and should be used with extreme caution by these companies...Like is it worth peoples time to spend ten\fifteen dollars (they have to eventually charge for this) to let AI create a, to be freank, half-assed valley of the uncanny movie? I respect the technology and what they're trying to accomplish but this just seems like they're going completely all in on an industry that's laid waste to smarter people than Mark.
  • crakhamster01 2y ago
    In Facebook's case they have more to gain than just nifty gen AI features - better ads, content recommendations, etc. The investment in AI infra is a moat, and is why FB's ad platform has proven to be much more resilient to tracking changes than their competitors (e.g. Snap).
  • hcks 2y ago
    You're right, Meta shouldn't invest in a breakthrough technology. They should focus on what really matters: delivering short term value to shareholders
• heurist 2y ago
  I've been saying for years that generated content is an impending tsunami that's going to drown out all real human voices online. The internet may become effectively unusable as a result for anything other than entertainment.
  • boogieknite 2y ago
    This is interesting and i see some of this now. Even here on HN and other forums i thought were mostly "human". Even one of my group chats i can tell one of my friends is using ai responses, but one of the other members cant tell and replies earnestly. I am grossed out by this. my instinct is to avoid ai slop. The interesting part to me is: What next? Where do we go? Will it be that "human" forums are pushed further into obscurity of the internet? Or will go so far as that we all start preferring meeting in person? Im clueless here
    • whiplash451 2y ago
      Cryptography-secured/signed generated content / interactions?
      • 93po 2y ago
        worldcoin project solves a lot of this when combined with web of trust, however everyone's knee jerk reaction to worldcoin is pretty bad and so it's annoying to even mention it
        • whiplash451 2y ago
          I’m not knowledgeable in crypto/worldcoin. I was rather thinking classical cryptography baked into generative networks.
        • tim333 2y ago
          Worldcoin was intended to solve it but in practice it's not being used that way. Not enough adoption by users or websites. Maybe in the future? I'm a worldcoiner but so far it's just been free money.
• mike_hearn 2y ago
  The paper that comes with this is nearly as crazy as the videos themselves. At a cool 92 pages it's closer to a small book than a normal scientific publication. There's nearly 10 pages of citations alone. I'll have to work through this in the coming days, but here's a few interesting points from the first few sections. For a long time people have speculated about The Singularity. What happens when AI is used to improve AI in a virtuous circle of productivity? Well, that day has come. To generate videos from text you need video+text pairs to train on. They get that text from more AI. They trained a special Llama3 model that knows how to write detailed captions from images/video and used it to consistently annotate their database of approx 100M videos and 1B images. This is only one of many ways in which they deployed AI to help them train this new AI. They do a lot of pre-filtering on the videos to ensure training on high quality inputs only. This is a big recent trend in model training: scaling up data works but you can do even better by training on less data after dumping the noise. Things they filter out: portrait videos (landscape videos tend to be higher quality, presumably because it gets rid of most low effort phone cam vids), videos without motion, videos with too much jittery motion, videos with bars, videos with too much text, video with special motion effects like slideshows, perceptual duplicates etc. Then they work out the "concepts" in the videos and re-balance the training set to ensure there are no dominant concepts. You can control the camera because they trained a dedicated camera motion classifier and ran that over all the inputs, the outputs are then added to the text captions. The text embeddings they mix in are actually a concatenation of several models. There's MetaCLIP providing the usual understanding of what's in the request, but they also mix in a model trained on character-level text so you can request specific spellings of words too. The AI sheen mentioned in other comments mostly isn't to do with it being AI but rather because they fine-tune the model on videos selected for being "cinematic" or "aesthetic" in some way. It looks how they want it to look. For instance they select for natural lighting, absence of too many small objects (clutter), vivid colors, interesting motion and absence of overlay text. What remains of the sheen is probable due to the AI upsampling they do, which lets them render videos at a smaller scale followed by a regular bilinear upsample + a "computer, enhance!" step. They just casually toss in some GPU cluster management improvements along the way for training. Because the MovieGen was trained on Llama3 generated captions, it's expecting much more detailed and high effort captions than users normally provide. To bridge the gap they use a modified Llama3 to rewrite people's prompts to become higher detail and more consistent with the training set. They dedicated a few paragraphs to this step, but it nonetheless involves a ton of effort with distillation for efficiency, human evals to ensure rewrite quality etc. I can't even begin to imagine how big of a project this must have been.
• gcr 2y ago
  > Upload an image of yourself and transform it > into a personalized video. Movie Gen’s > cutting-edge model lets you create personalized > videos that preserve human identity and motion. A stalker’s dream! I’m sure my ex is going to love all the videos I’m going to make of her! Jokes aside, it’s a little bizarre to me that they treat identity preservation as a feature while competitors treat that as a bug, explicitly trying not to preserve identity of generated content to minimize deepfake reputation risk. Any woman could have flagged this as an issue before this hit the public.
  • PhearTheCeal 2y ago
    When I read that text my first thought was making some videos of my mom that passed away, since so few videos of her exist and pictures don't capture her personality
    • schlick 2y ago
      This is a Black Mirror episode: https://en.wikipedia.org/wiki/Be_Right_Back https://en.wikipedia.org/wiki/Be_Right_Back
    • garrettgarcia 2y ago
      The fact that your first thought was how you could use this amazing tech to remember a lost family member who you love, and OP's first thought was that it could be used for evil so it shouldn't exist says a ton about each of you.
      • allturtles 2y ago
        Well I think the second use sounds creepy, too. I'm sure that says a ton about me.
        • hackable_sand 2y ago
          Nah u not wrong Both unhealthy
      • 2y ago
• darepublic 2y ago
  The problem with gen AI right now is it still feels fairly obvious. There are numerous YouTube channels that primarily rely on gpt for the visuals. And I don't like them.
  • AzzyHN 2y ago
    Obvious to many, but not most, if Facebook is anything to go by
  • tiborsaas 2y ago
    I know people who use it day to day in their production workflow for ads and installations. You'd never know if they wouldn't break it down for you. Imagine 1 second scenes which happens so fast your bran just accepts it as "hand made" or professional job. 90% of it was generative AI, but the "good news" is that it still required a human editor who just happened to save a ton of time to make something that wasn't commercially viable because the client wouldn't paid for it otherwise.
• animanoir 2y ago
  wow more useless tech
• smusamashah 2y ago
  One extra clip on their blog post https://ai.meta.com/blog/movie-gen-media-foundation-models-generative-ai-video/ https://ai.meta.com/blog/movie-gen-media-foundation-models-g...
• zoogeny 2y ago
  I wonder how they will package this as a product. I mean, there is some advantage to keeping the tool proprietary and wrapping it in a consumer product for Instagram/Facebook. What I hope (since I am building a story telling front-end for AI generated video) is that they consider b2c and selling this as a bulk service over an api.
  • takinola 2y ago
    The obvious use case for Meta is content generation. They provide the tools to content creators who create new content to post on Facebook/Instagram which increases Meta’s ad inventory
• alexawarrior4 2y ago
  It is important to note, no matching audio dialog, or even an attempt at something like dialog. This seems to be way beyond current full video generation models.
• modeless 2y ago
  Did I miss it or did they not say anything about letting people actually use these models, let alone open sourcing them?
• intended 2y ago
  Man, everyone is happy with these advancements, and they are impressive. I’m here looking at users and wondering - the content pipelines are broader, but the exit points of attention and human brains are constant. How the heck are you supposed to know if your content is valid? During a recent apple event, someone on YT had an AI generated video of Tim Cook announcing a crypto collaboration; it had a 100k users before it was taken down. Right now, all the videos of rockets falling on Israel can be faked. Heck, the responses on the communities are already populated by swathes of bots. It’s simply cheaper to create content and overwhelm society level filters we inherited from an era of more expensive content creation. Before anyone throws the sink at me for being a Luddite or raining on the parade - I’m coming from the side where you deal with the humans who consume content, and then decide to target your user base. Yes, the vast majority of this is going to be used to create lovely cat memes and other great stuff. At the same time, it takes just 1 post to act as a lightning rod and blow up things. Edit: From where I sit, there are 3 levels of issues. 1) Day to day arguments - this is organic normal human stuff 2) Bad actors - this is spammers, hate groups, hackers. 3) REALLY Bad actors - this is nation states conducting information warfare. This is countries seeding African user bases with faked stories, then using that as a basis for global interventions. This is fake videos of war crimes, which incense their base and overshadow the harder won evidence of actual war crimes. This doesn’t seem real, but political forces are about perception, not science and evidence.
  • yieldcrv 2y ago
    I only care about being able to express myself more easily Maybe get a job where interviewers are biased against my actual look and pedigree Just ignore everyone else’s use of the tool
    • mitthrowaway2 2y ago
      > Just ignore everyone else’s use of the tool That's precisely the hard part!
  • AyyEye 2y ago
    The Information Bomb. There's a reason military types and spooks are joining the boards of OpenAI and friends. https://www.goodreads.com/book/show/203092.The_Information_Bomb https://www.goodreads.com/book/show/203092.The_Information_B... > After the era of the atomic bomb, Virilio posits an era of genetic and information bombs which replace the apocalyptic bang of nuclear death with the whimper of a subliminally reinforced eugenics. We are entering the age of euthanasia.
• pk-protect-ai 2y ago
  It is really amazing how consistent this model is in demo videos about world object details over time. This spatial comprehension is really spooky and super amazing at the same time. I hope Meta will release this model with open weights and open code, as they have done for the LLaMA models.
  • ein0p 2y ago
    Problem is, the moment they release weights someone will fine tune it to generate porn, including CP. So I wouldn’t hold my breath for the weights release - no legal dept will sign off on something with this much fallout potential.
• chasing 2y ago
  Periodic generative AI reminder: It will not make you creative. It will not give you taste or talent. It is a technical tool that will mostly be used to produce cheap garbage unless you develop the skills to use it as a part of your creative toolkit -- which should also include many, many other things.
• deleted 2y ago
  [deleted]
• Juliate 2y ago
  Impressive but meh. Impressive on the relative quality of the output. And of the productivity gains, sure. But meh on the substance of it. It may be a dream for (financial) producers. For the direct customers as well (advertisement obviously, again). But for creators themselves (who are to be their own producers at some point, for some)? On the maker side, art/work you don't sweat upon has little interest and emotional appeal. You shape it about as much as it shapes you. On the viewer side, art that's not directed and produced by a human has little interest, connection and appeal as well. You can't be moved by something that's been produced by someone or something you can't relate to. Especially not a machine. It may have some accidental aesthetic interest, much like generative art had in the past. But uninhabited by someone's intent, it's just void of anything. I know it's not the mainstream opinion, but Generative AI every day sounds more and more like cryptocurrencies and NFTs and these kinds of technologies that did not find _yet_ their defining problem to which they could be a solution.
• azinman2 2y ago
  Unless I'm missing something, this technology's harmful potential outweighs the good. What is the great outcome from it that makes society better? MORE content? TikTok already shows that you can out-influence Hollywood/governments in 10 seconds with your smartphone. Heck, you can cause riots through forwarding text messages on WhatsApp [1]. Not everything that can be done should be done, and I think this is just too harmful for people to work on. I wish we'd globally ban it. [1] https://www.dw.com/en/whatsapp-in-india-scourge-of-violence-inciting-fake-news-tough-to-tackle/a-52709823 https://www.dw.com/en/whatsapp-in-india-scourge-of-violence-...
  • paul7986 2y ago
    I agree with Neil Degrasse Tyson AI will kill the Internet https://www.youtube.com/watch?v=SAuDmBYwLq4 https://www.youtube.com/watch?v=SAuDmBYwLq4 Though maybe there's hope if.. 1. All deepfake image & video tech are enforced to add watermark labels & all websites that publish are force to label fake too. 2. Crazy idea but a govt issued Internet ID (ID.me is closest to that now with having to use to file taxes with the IRS) where your personal repuation and credit score are affected by publishing fake/scam/spam crap on the Internet ..affectively helping to destroy it. I want good actors on the web not ones that are out for a buck and in turn destroying it.
    • echoangle 2y ago
      1. will never happen, it’s way too interesting that people won’t try to make an open source version where the watermark can easily be removed by users. Unless you actually criminalize it and put people in jail multiple years for building anything close to deepfakes, you won’t be able to prevent that.
      • paul7986 2y ago
        That's why websites uploaders need to read the meta data and found out how it was originally generated then publish / label it ..AI generated it its first creation was such.
• moomoo11 2y ago
  This is great. Honestly imagine we get to a point this technology makes most things so demystified we move on to things that are more difficult. Like cool a movie doesn’t need to cost $200 million or whatever. Imagine if those creative types were freed up to do something different. What would we see? Better architecture and factories? Maybe better hospitals?
• tyjen 2y ago
  While we're still a fair distance away from creating polished products capable of replacing Hollywood gatekeeping; the bursting of the creative dam is on the horizon and it's exciting! I'm looking forward to when you can write a script and effectively make your own series or movie. Tweaking it as you go to fit your vision without the exhausting a large amount of resources, capital, and human networking to produce similar products pre-AI.
• ramshanker 2y ago
  It feels like in the field of AI, a major advancement happens every month now!
• benabbott 2y ago
  Things are about to get weird. We can't control this at any level: At the level of image/video synthesis: Some leading companies have suggested they put watermarks in the content they create. Nice thought, but open source will always be an option, and people will always be able to build un-watermarked tools. At the level of law: You could attempt to pass a law banning image/video generation entirely, or those without watermarks, but same issue as before– you can't stop someone from building this tech in their garage with open-source software. At the level of social media platforms: If you know how GANs work, you already know this isn't possible. Half of image generation AI is an AI image detector itself. The detectors will always be just about as good as the generators- that's how the generators are able to improve themselves. It is, I will not mince words, IMPOSSIBLE to build an AI detector that works longterm. Because as soon as you have a great AI content classifier, it's used to make a better generator that outsmarts the classifier. So... smash the looms..?
  • dinfinity 2y ago
    The challenge is to determine what is real, not what is fake. I think cryptographic signing and the classic web of trust approaches are going to prove the most valuable tools in doing so, even if they're definitely not a panacea.
    • lytedev 2y ago
      This comes up a lot. Because synthesis is so generally feasible plus the existence of very powerful editing tools for things like movies and whatnot, I'm guessing that it will simply become the norm to assume that any image, sound, movie, or whatever may be fake. I expect there won't be a way to verify something was synthesised or "real-synthesized" (since images and videos are ultimately synthesized themselves, just from reality instead of other synthesized content). Even with signing and web of trust we can only verify who is publishing something, but not the method of synthesis.
      • tintor 2y ago
        It can be verified if resulting video contains signed metadata with all intermediate steps needed to produce the video from original recording (which is digitally signed by camera). Downside is that large original video assets would need to be published, for such verification to work.
• rootedbox 2y ago
  Did this website kill anyone else’s phone?
• mucle6 2y ago
  The text to modify a video looks so cool
• tomw1808 2y ago
  Why does it look ... fake? Before you downvote, don't get this as a belittling the effort and all the results, they are stunning, but as a sincere question. I do plenty of photography, I do a lot of videography. I know my way around Premiere Pro, Lightroom and After Effects. I also know a decent amount about computer vision and cg. If I look at the "edited" videos, they look fake. Immediately. And not a little bit. They look like they were put through a washing machine full of effects: too contrasty, too much gamma, too much clarity, too low levels, like a baby playing with the effect controls. Can't exactly put my fingers on, but comparing the "original" videos to the ones that simply change one element, like the "add blue pom poms to his hands", it changes the whole video, and makes the whole video a bit cartooney, for lack of a better word. I am simply wondering why?! Is that a change in general through the model that processes the video? Is that something that is easy to get rid of in future versions, or inherently baked into how the model transforms the video?
  • slashdave 2y ago
    The models produce a form of average video, but with artificial sharpness added for a form of consistency. A truly and consistently original image requires something these models do not have, which is a world model.
• davedx 2y ago
  This is just the landing page for a research paper? It's hard to understand what the actual production capabilities of this are.
• jmakov 2y ago
  Wonder what a AI generated movie from the same script as original would look like.
• yorozu 2y ago
  (commented on wrong thread somehow)
  • mistercheph 2y ago
    Wrong thread :)
• phkahler 2y ago
  The kids kite is flying backwards....
• seydor 2y ago
  I can finally watch Star Wars the Smurfs edition
• tqi 2y ago
  A lot of folks in this thread have mentioned that the problem with the current generation of models is that only 1 in (?) prompts returns something useful. Isn't that exactly what a reward model is supposed to help improve? I'm not an ML person by any means so the entire concept of reward models feels like creating something from nothing, so very curious to understand more.
  • jprete 2y ago
    Bear in mind these systems have already been through the reward-based training, and these are the results that are good enough to show in public.
  • deisteve 2y ago
    I'm not so sure how much that is relevant to Meta Movie Gen. I've tried all the tools: Luma, Runway, Kling Luma is by far the worst and relatively compared to Runway and Kling by far produces the worst quality and unstable video. Runway has that distinctive "photo in the foreground with animated background" signature that turns many off. Kling and Runway share that same "picture stability" issue that is rampant requiring several prompts before getting something usable (note I don't even include Luma because its output just isn't competitive imho). This Meta Movie Gen seems to make heavy usage of SAM2 model which gets me super excited as I've always thought that would bring about that spatiotemporal golden chalice we always wanted, evident by the prompt based editing and tracking of objects in the scene (incredible achievement btw). Until I have the tool ready to try I will withhold any prejudgements but from my own personal experiences with generative video, this Meta movie gen is quite possibly SOTA. I simply have not seen this level of stability and confidence in output. Resolutional quality aside (which already Kling and Runway are at top of the game), the sheer amount of training data that Meta must have at disposal must be far more than what Kling (scrapes almost the entirety of Western content, copyrights be damned) and Runway can ever hope to acquire, plus the top notch talented researchers and deep learning experts they house and feed, makes me very optimistic that Meta and/or Google will achieve SOTA across the board. Microsoft on the other hand has been puttering along by going all in on OpenAI (above, below and beside) which has been largely disappointing in terms of deliverability and performance and trying to stifle competition and protect its feeble economic moat via the recently failed regulatory capture attempt. TLDR: this is quite possibly SOTA and Meta/Google have far more training data then anybody in the existing space. Luma is trash.
• sleepybrett 2y ago
  It should be federal law that any video created with GenAI should be watermarked both stenographically and visually. (Same goes for images and audio.. not sure what can be done about ascii)
  • rolux 2y ago
    Stenography is writing in shorthand. What you mean is steganography. You can also watermark plain text by generating "invisible" patterns. Of course, in all these cases, the watermarks are trivial to remove: just re-encode the output with an open model. Which is why I hope there will be no federal law that tries to enforce something that is categorically unenforceable.
    • sleepybrett 2y ago
      yes sorry, i think autocorrect got me when I wsn't looking. If the feds catch you removing watermarks you go to prison. Problem solved.
• qwery 2y ago
  What can you even say about this stuff? It's another incremental improvement, good job Mark. These new video clips of yours are certainly something. I don't know how you do it. Round of applause for Mark! I will now review some of the standout clips. That alien thing in the water is horrifying. The background fish look pretty convincing, except for the really flamboyant one in the dark. I guess I should be impressed that the kite string seems to be rendered every frame and appears to be connected between the hand and the kite most of the time. The whole thing is really stressful though. drunk sloth with weirdly crisp shadow should take the top slot from girl in danger of being stolen by kite. man demonstrates novel chain sword fire stick with four or five dimensions might be better off in the bin... > The camera is behind a man. The man is shirtless, wearing a green cloth around his waist. He is barefoot. With a fiery object in each hand, he creates wide circular motions. A calm sea is in the background. The atmosphere is mesmerizing, with the fire dance. This just reads like slightly clumsy lyrics to a lost Ween song.
  • hcks 2y ago
    Round of applause for this useless unsubstantiated comment
  • chaos_emergent 2y ago
    it's totally wild that your first response is shitting on flaws rather than having your jaw drop at machines producing coherent videos from text. This is _the worst that machines will ever be at this task_, and most of the improvements that need to be made are a matter of engineering ingenuity, which can be translated to research dollars.
    • salmonet 2y ago
      This is Hacker News. That comment was way more positive than I expected for something like this and so I assumed this must be pretty awesome
    • qwery 2y ago
      It certainly wasn't my intent to trash the whole thing, so I'm sorry it came across that way. They've done well. They combined a whole bunch of techniques in a new way, or at least in a better way than we've seen before. I don't think you should be surprised to see these results today. > This is _the worst that machines will ever be at this task_ This is wrong. We've seen worse and we've seen far, far worse -- what I mean is that we've seen plenty of iterative development in video generation. Even if you only consider machine-learning based video from text prompts. Then consider other generative systems as well as other video research and technology like motion interpolation, depth map generation, etc.. It's an extremely active field.
• mempko 2y ago
  Hippos can't swim. Things are about to get weird where people will start believing strange things. We already have people believing Trump helped people during the hurricane, with images of him wading through water (that are clearly AI generated if you look close enough). We are going to get a form of model collapse at not just the AI level, but societal one.
• deleted 2y ago
  [deleted]
• garrettgarcia 2y ago
  Harry Potter-style moving pictures are now a reality.
• swayvil 2y ago
  Just feed it a book?
• throw310822 2y ago
  The porntential is immense. Seriously though. This is the company that is betting hard on VR goggles. And these are engines that can produce real time dreams, 3d, photographic quality, obedient to our commands. No 3d models needed, no physics simulations, no ray tracing, no prebuilt environments and avatars. All simply dreamed up in real time, as requested by the user in natural language. It might be one of the most addictive technologies ever invented.
  • afh1 2y ago
    Or a multi billion dollar fluke like the Metaverse. Time will tell.
  • complianceowl 2y ago
    Hahahaha. I think Websters Dictionary may be interested in hiring you.
    • skywhopper 2y ago
      That’s not how dictionaries work.
      • complianceowl 2y ago
        Ya don't say.
  • jiggawatts 2y ago
    Did you just pornify a word?
  • deleted 2y ago
    [deleted]
  • jsyang00 2y ago
    Meta is already a target for regulators - they are going to have to be very careful around this. I think this is why the "metaverse" is still more likely to be decentralized than created by a tech giant. Even if Meta wanted to take a libertarian, "dream whatever you want", stance or even a "dream whatever you want so long as it is more or less legal" stance, they would see a regulatory deluge come pouring down on them. There is no way VR will be able to go mainstream without a drawn out fight over content prohibitions. I think the early internet was a bit of a historical outlier in this sense, where it happened to come about when a relatively laissez-faire attitude towards censorship was prevailing and people did not realize the full impact it would have. That is not the case now. People understand on all sides that this technology has the potential to revolutionize our systems of social relations once again, and I suspect that they will be fighting tooth and nail to shape that outcome as they most desire.
• sanj 2y ago
  Hippos don't float.
• dangsux 2y ago
  [dead]
• zamadatix 2y ago
  When the comments range from "it's the demise of the world" to "it doesn't look quite right" (and everything in-between) you get a sense of just how early we are into this decade's "big new tech thing".
• lucasyvas 2y ago
  Well I wouldn't have called it, but I think Meta is in the lead. They beat Apple to AR and affordable VR. Their AI tooling has basically caught up to OpenAI and at this rate will pass them - is anyone else even playing? Maybe their work culture is just better suited to realizing these technologies than the others. They're not really showing signs of slowing down either. Hey, Zuck, always thought you were kind of lame in the past. But maybe you weren't a one trick pony after all.
  • the8472 2y ago
    > is anyone else even playing? Deepmind. Protein folding and solving math problems is just less sexy.
  • deleted 2y ago
    [deleted]
  • deleted 2y ago
    [deleted]
• TranquilMarmot 2y ago
  Most of the comments here talking about bad actors using this for misinformation, but they're ignoring what Meta does- it collects your information and it sells ads. Especially based on the examples on this site, it's not a far reach to say that they will start to generate video ads of you (yes, YOU! your face! You've already uploaded hundreds of photos for them to reference!) using a specific product and showing how happy you are because you bought it. Imagine scrolling Instagram and seeing your own face smelling some laundry detergent or laughing because you took some prescription medicine.
• bilekas 2y ago
  This just seems to serpent eating its own tail and distopian to me, Facebook, a company where people share their own content like videos and pictures now generating content from nothing but AI. To what end?
• bhouston 2y ago
  Where can I download this model? Meta is the open source AI company right?
  • thriwster 2y ago
    Meta is not the open source AI company. LLaMa (or whatever capitialization that was) was leaked. They ran with that because hey it makes them stand out vs your "Open""AI" and Anthropic etc. But if strategy changes they will happily close the drawbridge. In other words it is a corporation and has no inherent persistent ethics.
• eth0up 2y ago
  Alright, I may or may not be a moron, but none of my versions of Firefox can connect to this site because 'some HSTS shit'. Anyone able to update/inform a dinosaur?
• terminatornet 2y ago
  does anyone have an example of an AI generated video that's more than 10 seconds long that doesn't look like garbage? All of these tools seem to generate a weirdly zooming shot of something that turns a little bit and that's about it. Anything longer than a single clip is just a bunch of these clips stitched together.
• famahar 2y ago
  I've kinda given up on the internet at this point. It's sad but comforting. My social networks are just my friends and I've started to get back into reading books and long form blogs. Don't want to be exposed to this endless slop. Every day it gets harder to find something that was so easy before. It's all being buried by endless content. I'm hoping some non AI generative content branch of the internet will be created. Don't know if something like that is possible. Curation seems like the next best step.
  • vouaobrasil 2y ago
    I was thinking exactly that: a coalition of people who refuse to use AI, and who refuse to interact with or support others who do use AI. I actually work for Photography Life, and we have already committed to 100% AI free: no generative AI for articles and no gen AI for photos either. I also have a 100% AI-free commmitment on my YouTube channel. Procreate for iPad believes in no AI as well. But we need more supporters. Place AI-free banners on your site if you have one and send me the link. Encourage others to declare their support against AI. Writing and art is about communicating what humans make because it transmits experience! We have to come together and refuse as much as possible to support those who use AI! Feel free to contact me if you want to collaborate!
    • deisteve 2y ago
      coalition makes it sound like its in the millions all coordinating together like these guys : https://en.wikipedia.org/wiki/Luddite https://en.wikipedia.org/wiki/Luddite
      • vouaobrasil 2y ago
        I am happy to declare that I am myself, a Luddite in many ways. No problem with that. I like lots of technology, not gonna lie. I'm a programmer and have a PhD in math, but I think it's gone too far in many respects. And if I have to build a coalition into millions, I'll do it one step at a time.
        • 2y ago
• petabyt 2y ago
  I'm sick of seeing this generative stuff. It's at least 50% of the content I see online these days. At this point it's so refreshing to see real photography and art, made by real humans. I hope we never lose that.
  • ninetyninenine 2y ago
    You’re not sick of it. Because 50 percent of the stuff you think isn’t generative actually is. You love a lot of this generative stuff you just hate idea of knowing it’s generated.
    • petabyt 2y ago
      Sorry, but I've been doing photography for so many years I can easily tell the difference. I don't care if you don't believe me though. But yes, this is also about authenticity. There's a big difference between something that happened and something that didn't.
      • ninetyninenine 2y ago
        I don't believe you at all. I think you're either a liar or a lying to yourself. https://www.gounfaked.com/ https://www.gounfaked.com/ I think it's possible you may think you would be able to differentiate AI generated photos and real photos. But if you looked at that site and told me the SAME thing, then I would know that you actually are lying to me.
• ggalaxx 2y ago
  [flagged]
• tracerbulletx 2y ago
  The most powerful example for me is actually the rain one because it will probably be good enough for lower key effects shots like that to replace a lot of jobs there. More complex generations might look goofy for a while, but if it's good for sky replacement, pyrotechnics, and other line of work effects shots its going to be heavily disruptive.
• woggy 2y ago
  It's already bad, but the amount of garbage that is going to flood YouTube now is going to make it unusable.
  • cpill 2y ago
    oh yeah, YouTube is a pristine environment right now
    • oblio 2y ago
      Yeah, but it's going to become 100x worse. And for the average person, 1000x worse.
      • rnewme 2y ago
        Depends on algo, not content. There s enough content even without people gaming the algo.
  • bamboozled 2y ago
    I’m already sick of all the bullshit thumbnails to be honest. It’s at the point where I feel like giving up my premium subscription.
    • gitaarik 2y ago
      You would maybe like this YouTube click-bait reducing browser plugin: https://dearrow.ajay.app/ https://dearrow.ajay.app/
      • bamboozled 2y ago
        Thank you , my issue is, YouTube should be doing this for me. I’m paying them for a service.
  • bufferoverflow 2y ago
    No, it won't. Youtube is kind-of like Reddit or HN. "Good" stuff floats to the top, "bad" stuff disappears into nothing.
• reneberlin 2y ago
  We humans are so excessively dependent on vision input and with entertaining through visuals, too. But more and more all those visuals become meaningless to me and it all just feels like fast-food-junk to me. As any pre-schooler will be able to produce anything (watch out parents) imaginable in seconds doesn't make it better to me or is of any real value. Ok, i needed to edit it again to add: maybe this IS the value of it. We can totally forget about phantasizing stories with visuals (movies) because nobody will care anymore.
  • baby 2y ago
    Yeah I agree, I never understood the appeal of photography, it's so easy, you don't need to paint for hours to produce something original, you just need to buy a camera and click on a button. That's it. And people pay for that, I don't get it.
    • lurking_swe 2y ago
      is it easy? i’m not a photographer but i enjoy taking pictures as a hobby. Your opinion baffles me haha. People always wonder why their iphone can’t shoot photos that look as good as the iphone camera reviews. https://www.austinmann.com/trek/iphone-16-pro-camera-review-kenya https://www.austinmann.com/trek/iphone-16-pro-camera-review-... Understanding why your camera performs well in certain conditions and how to tweak the camera, is a mini-science all of its own. Also i think the reason photography is appreciated is because of composition. Knowing where to position yourself, and at what moment, can make photographs turn out magical. Your eyes are processing millions of frames a second, but a photographer often gets just ONE chance to capture some scenes. Some people appreciate the “art” in that. :) Here’s a thought experiment. Do you consider all wedding photographers to be of equal value? If not, why? Anyone can do it according to you. just click a button. Something to think about…
      • qup 2y ago
        It's sarcasm
• 752963e64 2y ago
  [dead]
• barumrho 2y ago
  Thinking about abuse potential, is there such a thing as irreversible finger-printing of media generated like this? So that even bad actors couldn't hide the fact that it was generated by AI.
  • dragonwriter 2y ago
    > is there such a thing as irreversible finger-printing No.
  • brenschluss 2y ago
    Here's an idea: https://news.ycombinator.com/item?id=39166038#39173769 https://news.ycombinator.com/item?id=39166038#39173769
• gorgoiler 2y ago
  Photo sharing websites (including Facebook) used to be wrappers around ImageMagick with extra features. I love how the backbone of their training involves calling out to ffmpeg. It gives a little hope to those of us who, too, are working on a smaller scale but with similar techniques. Scale? I have access to an H100. Meta trained their cat video stuff on six thousand H100s. They mention that these consume 700W each. Do they pay domestic rates for power? Is that really only $500 per hour of electricity?
  • Culonavirus 2y ago
    They're all investing into their own sources of power. I'm sure Zuck has a few deals in place too. https://www.businessinsider.com/google-considering-nuclear-power-energy-hungry-ai-data-centers-2024-10 https://www.businessinsider.com/google-considering-nuclear-p... > Both its competitors, Amazon and Microsoft, have already announced electricity deals with nuclear power stations. > In March, Amazon inked a $650 million deal to buy electricity from the Susquehanna nuclear power station, per the Financial Times. > Then, in September, Microsoft signed a 20-year deal to purchase energy from Pennsylvania's Three Mile Island nuclear plant, the plant's owner, Constellation Energy, said in a statement.
• bamboozled 2y ago
  Seems like it mops the floor with Sora
• _sys49152 2y ago
  change style to pencil sketch = absolute gamechanger. (penguins vid) thats the most amenable approach to ai filmmaking ive seen available yet. id have to see wayyy more pencil sketch conversions to see exactly whats going on.... ...but that right there is the easiest way to hack making movies - with the most control.....so far...
• anonzzzies 2y ago
  So can we try it? Announcements are no good.
• nektro 2y ago
  everyone who worked on this should be ashamed
• ribcage 2y ago
  AI destroying mankind has always been a theme, but it's probably not going to be in the form of a physical war. This picture generation will probably have a very negative impact on mankind. Imagination is one of the driving forces of mankind, and so is our desire to realize the things we desire. When these generators become a common thing, human imagination and intelligence will start inevitably degrading. Nobody will bother painting pictures, making music, making video games or movies, when anyone can just see and hear whatever they want instantly. And people will brobably work all day long just so come home and pay to use these generators. This has the potential to destroy mankind by destryoing the human spirit.
  • lpapez 2y ago
    People have been saying the same thing about Internet streaming of music for example. It didn't destroy musicians, just changed how they make their money. Musicians today generally publish music for free, and make money from concerts and merch sales instead (the publishing platforms generate money from ads around the publishing). Nothing will change about that with the onset of AI generated music - most music is already free today, so you pay for personal experience (i.e. a concert) instead.
    • ryukoposting 2y ago
      Music streaming didn't replace the artist themself, only the way their art was delivered. Music streaming also didn't posess the ability to interfere with democracy.
  • alex_suzuki 2y ago
    What about an endless supply of custom-tailored pr0n? Apart from the spirit, might simply wipe out actual physical reproduction.
• ksynwa 2y ago
  Facebook is already flooded with very strange (to put it kindly) AI boomer engagement bait AI images. I cannot help but think about how much worse the problem could get with AI generated videos. But they are not cheap to make right now.
• Aeolun 2y ago
  Why are there so many websites that are essentially static HTML that make my phone stutter? The video’s look cool, but I can’t really enjoy reading about them if my phone freezes every 2 seconds.
  • runeks 2y ago
    Which browser?
    • arendtio 2y ago
      And which device. Over the years, adding many simultaneous videos to websites has become quite common, and I have always marveled at how well many devices can handle this. Nevertheless, it is pretty demanding for the hardware, and many smartphones are not made for such tasks.
  • _heimdall 2y ago
    I'm seeing weird bank on a Pixel 6a / chromium browser as well. I'm on mobile so I can't check the source, but this can't just be static HTML. When I scroll the page, sections of text are missing then pop in, randomly though not as a scroll driven animation. It almost feels like something is blocking the browser's render loop and it can't catch up to actually paint the text. That'd be an insane bug on such a simple page, though I put nothing past react these days if they used it here.
    • joquarky 2y ago
      I'm also having trouble with the page. I wish web browsers had a "pause" button for scripts so I can just scroll to the bottom, let everything load and then hit pause and "freeze" the page contents so I can read without distractions. I also feel like the quality of web UX is in rapid decline, and nobody wants to hire competent web developers who grok the fundamentals anymore.
  • fasa99 2y ago
    Q: Why are there so many websites that are essentially static HTML that make my phone stutter? A: because your phone is a potato The first free tech support from HN is free, subsequent questions will be $29.99 per.
• shortrounddev2 2y ago
  I strongly believe this technology is bad
• lozzo 2y ago
  When I was little I used to think it was a shame that I could not show my dreams. I could tell my parents what I dreamt but not show them what I saw (or thought I saw while dreaming). Getting closer
• brisky 2y ago
  Was this trained on personal facebook video data?
• jcrona28 2y ago
  [dead]
  • falloon 2y ago
    Scam, don't click this.