13 ms·
AI made these movies sharper – critics say it ruined them
- feverzsj 3y agoThey look soulless.
- leotravis10 3y agoRelated discussion: https://news.ycombinator.com/item?id=38741536 https://news.ycombinator.com/item?id=38741536 "They want you to forget what a film looks like" | 310 points by zer00eyz | 3 months ago | 213 comments
- nerdix 3y agoThe AI upscaled 4K UHD version of Aliens is freakin' amazing. I know the main complaint with upscaling older movies is that it can remove most of the film grain and that can give people a waxy, mannequin like look. But they really found a nice balance in Aliens. I watched the non-UHD a few months ago and just recently saw the 4K version and the difference was pretty stark.
- SirMaster 3y agoWhat? I have both discs and I hate how the 4K looks. Overly smooth, and edge ringing artifacts everywhere...
- nerdix 3y agoI guess a lot of it just comes down to preference but I love the way it looks. I think HD Blu-ray was good and I didn't have any complaints but the 4K version looks much better to me. I also watched it on a projector with an 120 inch screen which I think benefits a lot from the increased resolution.
- peter303 3y agoReminds of "fugi film": the standard development make the colors brighter than reallife. The customers liked that better, even if less accurate.
- 0x53-61-6C-74 3y agoI think this would be amazing for jank 90's CGI. The movie "Event Horizon" terrified me as a child. I went to rewatch it as an adult, I could not get past the jank CGI, it pulled me out of my suspension of belief.
- Sateeshm 3y agoI prefer the originals. Warts and all
- noahtallen 3y agoI find it really odd that they’re comparing the streaming version vs the new Blu-ray, rather than previous Blu-ray vs new Blu-ray. (Not to mention the HDR & color space issues mentioned already). The streaming copy is compressed so terribly that it contains at least 2x less information, and normally much worse. (A great UHD disk can be up to 120mbps, compared to 10-20 on streaming if you get lucky.) So when we’re trying to compare the minutiae in each frame, it makes no sense to compare to a copy that already had a lot of information removed via compression. Also, the 4k streaming copy is nearly always worse than the 1080p Blu-ray.
- deleted 3y ago[deleted]
- pvaldes 3y agoRepaint the product, sell it as new again.
- MaxBarraclough 3y agoI don't see anything wrong with selling an upscaled film as a new product, if it's done well. Doing a decent upscale isn't trivial, and quality is often improved significantly. Like anything, not all upscaled re-releases are of worthwhile quality.
- Dylan16807 3y agoRepainting takes effort too. But it's so vastly less effort than the original. Charging the new customer price to previous owners sucks.
- yoyopa 3y agolooks like it made everything darker
- GaggiX 3y agoI wonder if there was a conversion between HDR and standard image format to make the images look so dark, I'm not too familiar with this technology.
- extr 3y agoYeah i’m guessing whoever pulled the images for the article didn’t correct for the newer versions being HDR.
- jsnell 3y agoIt's quite strange, because the article text talks about how the "colors are bright and vivid, while blacks are deep and inky" and the problem is that the surface details look off. But then on the screenshots all you can see is a difference in the color grading, and no details of any kind. Like, the problem with the closeup of Jamie Lee Curtis isn't the skin texture like suggested in the subtitle. It's that she is blue.
- kelseyfrog 3y agoIt completely ruined the grading and killed the skin tones. There's many other things wrong, but making the actors look like gray clay isn't helping at all.
- dinkblam 3y agodidn't you notice that most movies and series in the last 5 years have been dark to the point of not even being able to to notice which eye color people have? not enough to ruin all the newly produced stuff, they also need to ruin all the old stuff now...
- yonaguska 3y agoIt's big OLED conspiring to force us to buy more expensive TVs with better blacks. /s
- mikkom 3y agoPaywalled for me
- dedosk 3y agoThis works a bit https://web.archive.org/web/20240414193245/nytimes.com/2024/04/13/movies/ai-blu-ray-true-lies.html https://web.archive.org/web/20240414193245/nytimes.com/2024/...
- cayal 3y agohttps://archive.is/ug4an https://archive.is/ug4an
- andrewstuart 3y agoAI will be applied to every possible thing it can be.
- HenryBemis 3y agoAnd re-packaged and re-sold, and people will re-buy and re-watch/re-consume. Imagine "Lord of the Rings - the full trilogy in three 8-hour movies, now with new AI-generated content that fills the gaps left from the 'extended' releases. I know people that will definitely renew their HBO subscriptions in order to watch them (if/when they re-release one movie per year)
- cout 3y agoI would pay to see the missing Scouring of the Shire even as a poorly done AI render.
- deleted 3y ago[deleted]
- dvh 3y agoTime to update "software Peter principle" to "ai Peter principle"
- furyofantares 3y agoDidn't the Peter Principle have to do with organizations of the late 60s, and not anything to do with software?
- dwighttk 3y agoai will be promoted to it's level of incompetence just like people in "organizations of the late 60s" (or today)
- Mountain_Skies 3y agoMaybe it can do something about the muffled, mumbled dialog in modern productions.
- BurningFrog 3y agoCritics will always be critical.
- seeknotfind 3y agoAgree. Though today it's sharper, tomorrow you ask for the plot to be changed or for everyone to be wearing spinny hats. At least there's a shared experience now. If people find this outrageous, just wait until tomorrow. Better to accept the infinite progress unfolding before us than to spend another moment angry or enraged. All I ask for is choice.
- tmnvix 3y agoOr perhaps removing all the cigarettes? On second thought, that could be hilarious. It would make all the smokers just look like very thoughtful people constantly bringing their fingers to their lips.
- kgwgk 3y agohttps://twitter.com/Tuckerpete/status/1569478529892646913 https://twitter.com/Tuckerpete/status/1569478529892646913
- seadan83 3y agoCheck Arnold's hair: https://pbs.twimg.com/media/GBaikRhX0AEcjuy?format=jpg https://pbs.twimg.com/media/GBaikRhX0AEcjuy?format=jpg Almost looks like rotoscoping. > Better to accept the infinite progress unfolding before us than to spend another moment angry or enraged. Some would say this is infinitely regressive. From the twitter picture, it looks like a justified criticism, from the examples in the article, it's hard to tell whether there's a merited criticism or if it reflexive anti-AI'ism
- pera 3y agoThat picture reminds me of all those horribly bad "HDR" pics 15 years ago
- chilmers 3y agoI think this kind of AI "enhancement" is where CGI was in the 90s. It might be state of the art tech, but it's still very unrefined, and in ten or twenty years these remasters will look painfully dated and bad.
- josefx 3y agoPeople who knew what they where doing could pull of some timeless art with 90s CGI and a decade of improvements did not stop people from ruining otherwise good movies with bad GCI either. AI is just another tool that needs to be used correctly.
- mrob 3y agoI think it's worse than bad CGI. With bad CGI, you can use your imagination and interpret as what it would have looked like if they had unlimited time and budget. You can't do that with bad AI "enhancement", because it's an automation of that same imaginative process. You'd have to somehow mentally reverse the AI processing before imagining a better version, which is much more difficult.
- gdubs 3y agoI dunno – I look at the original Jurassic Park and it still looks pretty amazing to me. Same with Terminator II. In many ways I feel like as directors got more and more capabilities with the tools they became comically overused. I don't think it's the sophistication of the tools, but the way that they're wielded that will make them look dated, or timeless.
- dmitrybrant 3y agoMy biggest gripe with these AI film enhancements is that they are adding information that was never there. You're no longer watching the original film. You no longer have a sense of how contemporary film equipment worked, what its limitations were, how the director dealt with those limitations, etc.
- Mahnahnohnah 3y agoIts definitly an interesting point you bring up with the contemporary film equipment. Nonetheless, i do believe that most film makers are actually want to make a film not work around contemprary limitations.
- rullelito 3y agoDo most people care? I just want to eat popcorn and watch a movie.
- cout 3y agoI don't think that's universally true of all AI enhancement though. Information that is "missing" in one frame might be pulled in from a nearby frame. As others have pointed out, we are in the infancy of video enhancement and the future is not fundamentally limited. If that takes away from the artistic nature of the film I understand the complaint, but I look forward to seeing this technology applied where the original reel has been damaged. In those cases we are already missing out on what the director intended.
- pimlottc 3y agoIn part, we need more vocabulary to distinguish different techniques. Everyone is just "AI" right now, which could mean many different things. Standard terminology would help us discuss what methods are acceptable for what purposes and what goes too far. And it has to be terminology that the public can understand, so they can make informed decisions.
- sandspar 3y agoI also think we already have a bunch of old words for the techniques, like "upscaling" or "statistics". It's "AI" everything now but the old words for the old techniques are waiting to be used again.
- procflora 3y agoWow, that tweet they link to with a super punched in shot looks really really bad! Hard to believe Cameron thought this looked better than just a normal 4k transfer, yikes. Was really looking forward to a UHD release of The Abyss but now I'm not so sure... https://twitter.com/RazorwireRyan/status/1735753526167347232 https://twitter.com/RazorwireRyan/status/1735753526167347232
- pimlottc 3y agoDirect image link: https://pbs.twimg.com/media/GBaikRhX0AEcjuy?format=jpg https://pbs.twimg.com/media/GBaikRhX0AEcjuy?format=jpg
- kombookcha 3y agoWild that somebody thought this was an improvement.
- ornel 3y agoThe "enhanced" image looks a lot like those retouched Russian photos from the Stalinist era
- ozymandias1337 3y agoExactly. It looks airbrushed as hell.
- pixelesque 3y agoIt's aggressively de-noised. Very much like modern phone cameras do these days: almost looks like a watercolour painting in some cases.
- pera 3y agoI really hate the result, they apply something like some gaussian filter followed by deconvolution which makes people's faces very uncanny: super soft skin with super sharp wrinkles
- gedy 3y agoIf I was to do this, I'd upscale for larger screens, but recreate the film grain and scratches as if it were just from larger negatives ¯\_(ツ)_/¯
- great_psy 3y agoThe issue I see with the screenshots from the article is that it changed the contrast and overall feel of the scene. I think there’s plenty of opportunity to exchange old videos, but I think it requires some human touch or deeper understanding of the movie to maintain its message. The light and contrast and color is made a certain way on purpose, usually to convert whatever the scene is meant to convey. You can’t just mess with those things just so you add details.
- JoyousAbandon 3y agoThe main issue is the totally invalid and ignorant comparison of compressed-to-hell streaming versions and Blu-Ray.
- seventytwo 3y agoWhy is everything darker and grayer? Is that an editorial choice? Or an AI artifact?
- AlienRobot 3y agoI think it's insane that the main argument for AI boils down to "everyone has 4K now so we need to upscale the videos."
- add-sub-mul-div 3y agoThe main argument for AI is for the rich to find a way to employ far fewer of the poor. Everything else is misdirection.
- MyFedora 3y agoEveryone has 4K is a dumb argument. Most have 1080p. The sensible upgrade path for PCs is 2K. Legal streaming services only support a few devices, so a 4K device may be stuck in 720p. HiDPI is also, somehow, still an unsolved problem in this day and age? Same thing with HDR, especially since many self-proclaimed HDR TVs aren't even good enough to achieve what any layman would expect from a HDR TV. So HDR certifications became a thing, amazing. But 1080p SDR remains the king for now.
- AlienRobot 3y agoAfaik the problem with HiDPI is that fractional scaling sucks, so you have to jump from 1x to 2x to have good quality. For 1080p, that means 4k. So you should end up with the same screen size as you have now, except with four times the pixels, and four times the electricity bill because your hardware needs to render all those extra pixels, and this for some marginal semblance of an improvement in image quality when you look closer at your monitor than you're recommended to if you want to keep your eyesight.
- crazygringo 3y agoThe "AI" versions of the movie stills are darker and "greener" or "bluer" in all cases in this article, which is NOT the case when you watch the movie. It's a mistake on the part of whoever put together the image comparisons. The culprit here is that the non-AI screenshots are taken from presumably 1080p non-HDR sources, while all the AI screenshots are taken from presumably 4K HDR sources. The "AI" images are all displayed in the completely wrong color space -- the dark+green/blue is exactly what HDR content looks like when played on software that doesn't correctly support decoding and displaying HDR content. It's a shame that the creator of the comparison images doesn't know enough image processing to understand that you can't grab stills from HDR content from a player that doesn't properly support HDR. On the other hand, the state of HDR support is a mess right now in software players. Playing HDR content in common players like VLC, QuickTime, IINA, and Infuse will give you significantly different results between all of them. So I can't actually blame the creator of the images 100%, because there isn't even a documented, standardized way to compare HDR to non-HDR content side-by-side, as far as I know (hence why each player maps the colors differently).
- dml2135 3y ago> On the other hand, the state of HDR support is a mess right now in software players. Playing HDR content in common players like VLC, QuickTime, IINA, and Infuse will give you significantly different results between all of them. This is the main thing that has kept me from adopting HDR in my media library. I'd expect a feature like HDR would be progressive (if that's the right term that I'm going for), i.e., in a non-supported player, it would look exactly like the non-HDR version of the content, and simply adds more dynamic range when in an environment that supports it. Without that, I'm not going to grab a version of a media file that might look worse if I'm playing it in a non-ideal context. Does anyone know why this isn't the case? Is it not technically possible for some reason I'm not thinking of, or was it really just a fumble of standards design?
- QualmsAplenty 3y agoThe shame is in comparing compressed-to-hell streaming versions to Blu-Ray in the first place, and commenting on how the Blu-Ray is "sharper." ANY Blu-Ray version should be much better than streaming. The NYT isn't free. I don't respect such shoddy feature-writing.
- deleted 3y ago[deleted]
- stephc_int13 3y agoAt some point this tech will become actually good and useable. But at this stage, nope, almost there, but not they should wait at least a few more years.
- QualmsAplenty 3y ago[dead]
- 39896880 3y agoLooks like what they did to buffy
- aaron695 3y ago[dead]
- spacecadet 3y ago‘This is not right! You’ve removed all of this stuff! If the negative is scratched, then we should see that scratch.’ People were really hard-core about it.” Dat me! But I shoot and process film on a home made camera, sometimes intentionally degrading the film, or processing without times, or mountain dew instead of water.
- spacecadet 3y agoOr 15 years ago when I made photographs using no camera and just objects, light, photo paper, dodge, burn, dodge, burn.
- bitwize 3y agoWhy is Arnold's head slightly larger in the AI version of the first screenshot? The ears do not align. Whatever the case, my wife and I went to see The Lost Boys the other day and it was grainy and blurry compared to the super-sharp previews and I just wouldn't have it any other way. Restoration is one thing. "Improving" it by smearing statistical filter juice over it is quite another.
- perardi 3y agoI appreciate the article (eventually) discuss that this is not generative AI—it’s machine learning-enhanced image processing, and it’s not hallucinating and inserting random background characters. This isn’t really a new debate. This is kinda the “it looks tacky to record a feature film at a high frame rate, Peter Jackson”. We have a cultural visual vernacular that guides how we expect certain media to look, and it just feels weird to have a movie from the last century remastered so that it looks like it was shot on the latest digital camera.
- wfleming 3y agoI recently watched the new Aliens remaster and actually thought it mostly looked very good. It was definitely a bit jarring at first because it doesn’t look like an 80s movie anymore: it’s too crisp. But once I got over the strangeness of it and realized some of my attachment to the original look was nostalgia I liked it. I do wish they’d kept more film grain, it’s a little too cleaned up, but it looks good nevertheless. From what I’ve read the same team did all these Cameron remasters, and True Lies was the first one so they were still figuring some stuff out and it’s more flawed as a result. Haven’t seen it yet, though. But based on Aliens I’m interested in rewatching The Abyss.
- 1vuio0pswjnm7 3y agoWorks where archive.is is blocked: https://web.archive.org/web/20240413093536if_/https://www.nytimes.com/2024/04/13/movies/ai-blu-ray-true-lies.html https://web.archive.org/web/20240413093536if_/https://www.ny...
- cdme 3y agoThese tools excel at sucking the soul out of creative work.
- _akhe 3y agoDo you prefer grain or clay-like rendery smoothness
- michaelbrave 3y agoWhen I was a kid I had a classic playstation (PS1) it had multiple kinds of video outputs, one of which was S-video, which was a lot sharper than composite, problem was sharper wasn't better, it made pixel games have sharp edged pixels and the blur and scanlines that blended were missing, it also made the motions of 3D things just look clunky and disconnected. In almost every way possible the higher resolution output made it look worse. So yeah, making a movie sharper could very likely make it worse.
- nottorp 3y agoAnd even on the PC side, every game drawn for a CRT monitor looks worse on a LCD because you don't get the free horizontal antialiasing or the tiny black spaces between horizontal lines... And then some people do masterpiece remasters like that Silent Hill where they removed the fog because modern systems can draw more. Also ruined the atmosphere.
- cchance 3y agoFeel like the AI Upscaling was either done shitty or the screenshots they used are really bad examples, no reason AI upscaling should make all the images darker for some reason lol
- efilife 3y agoThe AI source was HDR and the author of this article had no idea you can't just take a HDR screenshot and display it on non-hdr displays
- incorrecthorse 3y agoMany comments are missing the point here (although the article doesn't properly explain neither); it's not about resolution, but about fixing imperfections in filming: > The recent Cameron restorations were based on new 4K scans of the original negative, none of which needed extensive repair of that kind. [...] The A.I. can artificially refocus an out-of-focus image, as well as make other creative tweaks. “You don’t want to crank the knob all the way because then it’ll look like garbage,” Burdick said. “But if we can make it look a little better, we might as well.” The only movies which would require upscaling to 4K are those released between about mid-2000s to mid-2010s, the advent of native digital cinema, but filmed in 2K. Everything before was filmed in 35mm film, which can be scanned to 4K with information to spare; everything after is filmed in native digital 4K or more. Moreover, upscaling which deal only with resolution has absolutely no need of AI. Any TV will decently upscale in _real-time_ a non-4K movie, and more sophisticated techniques can give basically indistinguishable results. 2017's _Alien: Covenant_ was voluntarily produced in 2K but released in 4K through upscaling and the image look just great.
- dml2135 3y ago> The only movies which would require upscaling to 4K are those released between about mid-2000s to mid-2010s, the advent of native digital cinema, but filmed in 2K. Everything before was filmed in 35mm film, which can be scanned to 4K with information to spare; everything after is filmed in native digital 4K or more. Good to call this out, I think this is something that's really lost on people. It really blows my mind that George Lucas, for all of his apparent obsessive concern about his films supposedly looking dated, chose to shoot Star Wars Episode 2 in 1080p in contrast to Episode I on 35mm film.
- incorrecthorse 3y agoI guess 1080p was the big shiny edge thing back at the time. 35mm can supposedly be scanned beyond 8K, so you could theoretically consider 4K filming not good enough neither.
- samsk 3y agoMaybe I'm old, but do we really watch the movies because they are sharper, have vivid colors, etc or because of the story ? On the other hand, I would probably pay for an AI that will 'undark' that new super artistic movies, because some of them, have worse lighting than the Blair With Project...
- tiptup300 3y agoa lot of the people who purchase a lot of films buy them because they are sharper, have more vivid colors. Who knows if those whales are even watching most of their own collection.
- acuozzo 3y ago> Maybe I'm old, but do we really watch the movies because they are sharper, have vivid colors, etc or because of the story ? Where would, e.g., Koyaanisqatsi fit then?
- mrguyorama 3y agoHow many people watched Dune 1 and 2 because of a story that has been around for decades and already had one interesting film interpretation? How many people watched Avatar for the story? The existence of IMAX should be a hint that there is value in very crisp visuals. However, this stupid tiktok filter is NOT "very crisp".
- grujicd 3y agoSuper dark scenes might work on OLED screen, but every projector I saw including those in theatres can't display real black and darkest shades are always a problem. It's not a problem if you have bright parts in the same scene since eye will adapt. But everything is dark it won't look good in cinema. That affected how movies were shot, lighted, which kind of scenes were filmed at all. I wonder if some of those newer movies are intended to look better on modern TVs than in movie theather?
- bamboozled 3y agoYou're not old ,people just have a hammer and are looking for a nail. We'll see so much of this in the next few years, optimizing everything to the point of boring. Perfect pop songs, perfect movies, perfect novels and on it goes.
- dusted 3y agoIt used to be that (rational) people would be fairly in agreement that one cannot extract information which is not there. That's why we laugh at the "zoom -> 9 pixels -> enhance -> clear picture -> zoom ->.." trop in movies.. AI does not change this.. It adds stuff that's not there, sure, it adds stuff that might be there, or could have been there, but it literally cannot know, so it just paints in plausibility.. Which is horrible and gross already in principle. I imagine we're not far from the first conviction based on AI enhanced images.. give the model a blurry CCTV frame and a list of suspects and it will enhance the image until it looks like one of them, and since people are apparently this stupid, someone is going to be locked up for something they didn't do. Back to movies, just, fuck no! There's no enhancements to make, the movie is _DONE_, it looks like it does, leave it.
- dml2135 3y agoIt's frustrating that the article doesn't mention this relatively simple, well understood, and very relevant principle. (Unless I just missed it somewhere, someone please correct me if I'm wrong).
- Mahnahnohnah 3y agoThats not true. When you have moving film, you have 24fps from the same scene, a lens and a compression algorithm. There is a higher chance for pixel a to be color y if over a span of x frames and compression artifact this pixel shows value z. You will also have the chance to track details visible from frames/stills/pictures from seconds or even minutes ago if the actor just has the same cloth. And you can estimate the face of the actor across the movie and create an inherant face. Nonetheless, besides this type of upscaling, if an AI is trained to upscale based on probability of the real world and the movie is from the real world, it is still more than just random. Btw. there have been plenty of movie makers making movies the way they did because thats the only way they were able to make it. Low light high end camera equipment is expensive. And if you watch The Matrix without editing on a oled 60" and higher, it looks off because greenscreen details are more noticable than it has been before. Its aboslutly valid to revisit original material to adjust it to today (at least for me).
- pimlottc 3y ago
- Adverblessly 3y agoI watch AI enhanced movies and/or shows every day when I use Anime4K, a real-time ML upscaler for anime https://github.com/bloc97/Anime4K https://github.com/bloc97/Anime4K If you give shit-tier blurry DVD messes, it turns them into nicer blurry messes. If you give it the usual bitrate starved streaming quality show, it looks almost as nice as a blueray. If you give it a blueray... It basically comes out looking exactly the same. I'll usually still add its "darken lines" filter since I'm a fan of strong linework.
- thriftwy 3y agoIn the age of analog you could adjust brightness, contrast and color of the image. Still there and there are even presets, but not used much. I imagine in ten years you will be moving AI sliders to adjust brightness and contrast of the movie. Want to have everything super sharp? Art house? You can do that. At the same time, directors may spend more time on the actual story and less on the picture.