7 ms·
A lot of people saying it's over for traditional movie-making - lmao. I look at these and see nothing but uncanny valley artifacts, and I don't think it will im
by VoodooJuJu 4y ago
A lot of people saying it's over for traditional movie-making - lmao. I look at these and see nothing but uncanny valley artifacts, and I don't think it will improve much from here.
It's like self-driving cars. They use almost very effective statistical models, certainly better than our previous models, but they never seem to shake off that "almost" and become truly effective.
- appletrotter 4y ago> I don't think it will improve much from here. Any more specific reason why you feel this way? Curious
- criddell 4y ago> I don't think it will improve much from here That's a bold prediction. Why do you think that? The first thing I thought was the exact opposite. This isn't very good, but it's only version 1. Motion pictures are less than 150 years old. In another 150 years I bet virtual filmmaking will progress a lot.
- dgritsko 4y agoI agree, it feels like this technology is progressing by leaps and bounds almost by the day.
- paulgb 4y agoCase in point, just compare the results of Stable Diffusion / Dall-E / midjourney to papers from 5-10 years ago (here's a random one I found http://proceedings.mlr.press/v48/reed16.pdf http://proceedings.mlr.press/v48/reed16.pdf). Remarkable progress in that time, and as I understand it, a good amount (but certainly not all) of the improvement comes “free” from being able to scale up to more weights.
- javajosh 4y agoI don't agree with the prediction but I will say that at least in America, we've been overly optimistic about almost everything since world war II. Is particularly painful when you look at the imagination of science fiction versus the reality of science in the realm of say space travel, especially interstellar travel. This imagination effect gets the public behind your new invention in part because it seems to be just the beginning the start of something new. The tip of the iceberg. But sometimes it's really just a tiny bit of ice. For the record, I'm actually rather bullish on self-driving cars. There's nothing physically impossible about solving the problem, but I'm not surprised it's harder than it sounds. But I don't see humans being fundamentally prevented from solving the problem in the same way that humans are fundamentally prevented from ever engaging in everyday space travel.
- mikepurvis 4y agoAbsolutely, particularly if you see this as simply another tool in the belt, like how Jurassic Park's thirty year old special effects absolutely stand the test of time because of them being a convincing mix of early CGI and puppetry. It's not hard to imagine that this kind of thing could end up doing a lot of the heavy lifting for things like background scenes in the future, opening up the kind of stuff we saw in The Mandalorian, Game of Thrones, and the LOTR film trilogy to increasingly lower and lower budget productions.
- vsareto 4y agoMost of the AI generated images are good enough to be first drafts or sketches, and with some editing, they can be coherent images. This makes AI generators a good tool. Not sure the same is true for video though. It feels like you'll need reliable still image creation before you can get to a video generator that's useful since editing video takes a bit more than a still image.
- MichaelCollins 4y agoThe first Jurassic Park holds up unusually well. They used CGI for things they couldn't convincingly do any other way, and used practical effects for almost everything else. And for the most part they hid the CGI well, they took a lot of care to mix it up with close ups of practical effects, the way they framed the shots to direct audience attention, etc. I think in a lot of modern stuff they go too far. They now use CGI for things that could easily be practical effects, but they go with CGI because it's simply cheaper or because they want to A/B test different colors of wall paneling behind a character in post production, or who knows what. The end result is apparently good enough to make a billion dollars, but I can't stand it. Movies don't feel authentic anymore. It's hard to describe rationally, but the word 'soulless' sums up how movies made the new way make me feel. Even the scenes which are wholly practical/real get degraded; the excessive CGI and compositing used in the rest of the movie cast a miasma of unrealness across the entire movie. https://64.media.tumblr.com/248d25e2185a58bf827d329490480fb9/55a1eb08812b2f02-d3/s500x750/c1b6e7b7b6e21956bd7f60f7195794ea1e4998e9.jpg https://64.media.tumblr.com/248d25e2185a58bf827d329490480fb9...
- 4y ago
- mortenjorck 4y agoThe key to predicting technological advancement, that is so often misunderstood by technologists, is the S-curve. Laypeople tend to think everything is linear, technologists tend to think everything is exponential; more often than not, reality tends to be sigmoidal. Technologies have exponential takeoffs followed by logarithmic plateaus. We're clearly well into the exponential phase of deep-learning ML, but it's only a matter of time before this approach hits its logarithmic phase. Of course, the hard part of sigmoidal prediction is determining where in the curve we are. Does the current paradigm have an even steeper part ahead of it? Maybe. And yet, we could just as easily be right in the middle of the function, with a leveling off coming as the state of the art gives way to incremental improvements.
- deleted 4y ago[deleted]
- bottlepalm 4y agoIt’s been like a month since people were saying this tech would be too hard to apply to video.
- Xelynega 4y agoThe leap from "generating a frame" to "generating a video" is not as big as the leap from where we are now to a 'perfect' image synthesis engine(which would be required to get rid of artifacts). The much more likely scenario IMO is that people get used to the artifacts and notice them less.
- JieJie 4y ago
- bottlepalm 4y agoThere is something with the AI needing to have a ‘sense’ for the world the scene exists in so longer videos can be created that are coherent. Currently we’ve only seen long videos that have no consistency and jump around a lot like an acid trip.
- anigbrowl 4y agoYep, we're in a real hype cycle. A good path forward is to fuse these image-element compositing tools with some of the 3d scene inference ones. So you start out with 'giant fish riding in a golf cart, using its tail to steer', then give that as ground truth to a modeling tool that figures out a fish and a wheeled vehicle well enough to reference some canonical examples with detailed shape and structure, the idea of weight etc. Then you build a new model with those and do some physics simulation (while maintaining a localized constraint of unreality that allows the fish to somehow stay in the seat of the golf cart).
- kuu 4y agoWe already have films that use "similar" technology (for example, adding Leia in the new SW movies), and this is just another step, another improvement into the direction of autogenerated videos. Are we far from generating complete movies? Sure! Are we progressing? Yes too!
- antegamisou 4y ago> A lot of people saying it's over for traditional movie-making - lmao. The groups supporting such absurd claims largely boil down to: - Money-driven researchers in the applied AI field. Those are the people that spam popular ML conferences with barely novel contributions other than some minor tweaks on code from their previous papers. - People unable to critically think and evaluate the significant limitations of SOTA methods occasionally marketed as AGI breakthroughs. Last is virtually the entire HN userbase and the one that needs to be taken the least serious. The first category is much more troubling however, since they can significantly influence research directions due to the broken citation system in academia (more citations --> higher quality contributions).
- anigbrowl 4y agoOn your second point, a few years ago the SOTA was Google's Deep Dream. I agree with your deeper criticism, though preferential attachment/ranking is very much How Humans Do Things. You could do a much improved citation system by expanding the time dimension and looking at papers that were unpopular at first and then attracted wide interest later. Of course, academics also have a tendency to over-cite (because they don't want to be rejected for inadequate literature review), so there are incentives to cite a bunch of research whose premises or conclusions you hope to overturn.
- bm-rf 4y agoCogVideo was released only 4 months ago, you can see some samples on this page https://models.aminer.cn/cogvideo/ https://models.aminer.cn/cogvideo/. Statistical models can be used more efficiently (see KerasCV, https://news.ycombinator.com/item?id=33005585 https://news.ycombinator.com/item?id=33005585), and computing power can increase. I don't think AI will be able to create a movie anytime soon, but I think it will become "good enough" to serve as inspiration for creatives, or to replace simple stock footage (Much like SD and DALLE-2 is now).
- uup 4y ago> I look at these and see nothing but uncanny valley artifacts Ok? It's a nascent technology. Look at the original DALL-E blog post from last year [1]. Now compare it to DALL-E 2 and Stable Diffusion. [1]: https://openai.com/blog/dall-e/ https://openai.com/blog/dall-e/
- wslh 4y agoIf this technology (or its future iterations) is not enough you can always combine this with your movie cuts. This lowers the resources/bar needs for creative people and obviously also for the uncreative ones.
- hackerlight 4y agoThis tech went from nothing to beating a human artist in an art competition in a few years, and yet you say "I don't think it will improve much". So, I disagree.
- ZetaZero 4y agoRight and wrong. It's not over for traditional moving-making. It would be decades before the software and hardware could surpass. But it will improve tremendously, just like computers do for nearly everything.
- j45 4y agoThere's always the next curve of improvement by this tech or something else. It's just the first version and seeing Stable Diffusion come out while openai's tools were coming out were something to remember and think about.
- deleted 4y ago[deleted]
- squidbeak 4y agoThis is a good example of the most abject type of Luddism: telling yourself that a fast-developing tech you happen to dislike is already at or near the limit of its potential and that defects you notice now will be there forever.
- trention 4y agoYou will find plenty of comments in this very thread that are the most abject type of !Luddism.
- dang 4y agoPlease make your substantive points without name-calling. https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html
- anigbrowl 4y agoIt's not name calling to make a critique of an argument. Luddism is a real term that describes a particular philosophical tendency that places itself in opposition to what it views as a naive technophilia.
- dang 4y agoIt's a putdown, and a cliché one at at. No one calls themselves a Luddite unironically.
- MichaelCollins 4y agoThe Luddites were a labor rights movement reacting to the new shifting power dynamic of centralized production owned by a few, in an era with virtually no safety and worker rights regulations. How would you feel if your career evaporated and you were forced to choose between starvation and sending your children to work in a textile factory where they get maimed by the machines they're told to crawl into and repair? You probably wouldn't find much comfort in the popular retort of "but shirts are really cheap now!" That Luddites have been successfully maligned as irrationally anti-technology crazy people is a propaganda victory by industrialist factory owners and their friends, the newspaper men.
- liuliu 4y agoTheir video training set is still small (10M + 10M). A lot of the interpolation artifacts seems come from the model haven't acquired enough real-world understanding of "natural" movements (looking at the horse running and the sail-boat examples). I suspect scaling this up to 10x would have much less artifacts. Reading the paper, it seems to be the "right" approach (separating temporal / spatial for both convolution and attention). Thus, I am optimistic what remains is to scale it up.
- MichaelCollins 4y agoThe horse leg motion in these examples is really poor. But to be fair, horse legs are very difficult for human animators too, generally necessitating the use of reference photos to get it right. The first time somebody got a series of photographs showing a horse in motion caused quite a stir: https://en.wikipedia.org/wiki/The_Horse_in_Motion https://en.wikipedia.org/wiki/The_Horse_in_Motion
- iamsaitam 4y agoIt will definitely improve from here onward. On the other hand, I agree that it's a ridiculous thing to say that traditional movie-making is over. There's so much involved in making a movie, so much happenstance from the actors performances in a specific environment. You will never be able to get this in AI.. you might get some sort of mimicry, but the comparison is futile.. a movie isn't just a sequence of changing pixels.
- wokwokwok 4y agoI think it’s more complex than that. What you’re going to see is a race to the bottom, the same as with claymation films and 3d. It will suddenly require a lot less (expensive, highly trained) people to make the same films. You’ll still need expensive highly trained people to do it, but with different skills and a lot less of them can do a lot more a lot more quickly. …and that means that some studios will make bad, low grade films… and some studios will make amazing films using hybrid techniques (like 3d printed faces for claymation). …but overall, the people funding movies will expect to get more for less, and that will mean a downsizing of the number of people employed currently in certain roles. Traditional film making over? Hm… it’s complicated. Is it over if the entire industry changes, but people are still making films? Or is that just the “traditional” part of it which is over? It’s definitely going to change the industry. People will still definitely film things. …but, I wager, less people will be doing highly payed skilled manual work, which will replaced by a few people doing a different type of AI assisted work. …and we’ll see some really amazing indy films, of small highly technical teams producing content with very little physical filming.
- anigbrowl 4y agoAccurate, no notes.
- mrandish 4y ago> A lot of people saying it's over for traditional movie-making While these early versions are primitive, as a traditional filmmaker I think in a couple years these technologies will creatively empower visual storytellers in exciting new ways. The key will be developing interfaces which allow us to engage, direct and constrain the AI to help us achieve specific goals.
- bckr 4y ago> these technologies will creatively empower visual storytellers in exciting new ways Exactly. Every step forward in creative technology is additional leverage for the artist with a vision.
- britzkopf 4y agoI'm not sure I'd agree with the "it won't improve much from here" sentiment, but I am a little confused by the sharp disagreements with this comment. They seem to contain a tacit assumption that the complexity curve for this problem is smoothe, but I could easily imagine a very sharp elbow in that curve, making any progress come to a seemingly grinding halt.
- fullshark 4y agoThe only way it will be over is that tiktok/instagram will attract more eyeballs and hurt their bottom line. Ultimately this is for amateurs to create really short form content for the foreseeable future.
- terafo 4y agoYou are hilariously wrong if you think it will not improve. Combination of prompt engineering, better and bigger datasets, better architectures, bigger models, artifact-fixing tools and sheer human creativity will seriously challenge traditional movie-making within two years.
- sterlind 4y agoself-driving cars need safety guarantees. video's allowed to occasionally be crappy, it's not going to kill anyone. I thought the same way you did about speech-to-text and image search, back in the day. boy was I wrong.
- permo-w 4y ago> A lot of people saying it's over for traditional movie-making who is saying that?
- anigbrowl 4y agoMe, film-industry vet. You'll see an excellent mostly- or all-AI feature within 5-10 years. There will be terrible ones before that, maybe 2-3 years. The first really good one will be enjoyed on its own merits, ad the artificiality of it will come to light after it has gained popularity.
- permo-w 4y agoI would imagine you’ll see one or a few that are barely AI-produced as soon as marketing teams get wind of this. “come and see the first ever AI-produced* blockbuster! ⠀ ⠀ ⠀ *produced, assisted, or discussed on set one time during lunchbreak”