10 ms·
Netflix: 30% bitrate saving using Film Grain Synthesis
- ipaddr 4y agoWhatever changes netflix made recently has killed the entire experience where prime is now more responsive.
- ComputerGuru 4y agoI thought it was just my Apple TV.
- prng2021 4y agoNothing is worse than Disney+
- lame-robot-hoax 4y agoNothing is worse than Paramount+
- xeromal 4y agoHBO is pretty rough too. I travel a lot and I usually download a set of shows and movies to watch on various streaming services. 100% of the time, HBO fails to play it's downloaded content.
- marcus_holmes 4y agothis. In a hotel in Mexico with decent bandwidth. Netflix buffers to 20% and stops. Pirate/free sites play entire films no problem. Netflix (and most of the other streaming services) are dying because they no longer focus on customer experience, but on management goals. The recent move to declare password-sharing illegal is evidence - the nail in the coffin of the recording industry was when they started suing their own customers too.
- Doxin 4y agoThat first 20% of buffering is a lie. It'll manage to do that with no internet connection at all. Fair chance the hotel blocked netflix, or otherwise just doesn't have the bandwidth for streaming video.
- marcus_holmes 4y agoI logged in fine, though. And there's enough bandwidth for streaming from a free site with no problems.
- verdenti 4y ago[dead]
- crazygringo 4y agoThat's a gigantic savings, but not surprising since film grain (or noise generally) is the worst thing to compress. It's hard to think of any other single "feature" improvement that could result in such massive gains. I've always found it funny that the "HBO" branded intro to all their shows is produced of pure visual static. ([1] for anyone unfamiliar.) They literally couldn't have picked something worse to encode for streaming. https://www.youtube.com/watch?v=O08PQRA6MLo https://www.youtube.com/watch?v=O08PQRA6MLo
- Scaevolus 4y agoAt least the HBO logo decaying from analog noise to digital noise with compression artifacts makes sense. I'm also amused when they drop confetti and the screen turns into blocky slush. Another surprisingly hard to encode scene is water. Wave motion and shimmering is almost impossible to handle efficiently.
- eru 4y agoI guess unless your codec handles water physics. Which is not quite as absurd as it sounds. Have a look at the reflections in https://www.youtube.com/watch?v=udPY5rQVoW0 https://www.youtube.com/watch?v=udPY5rQVoW0
- matt-attack 4y agoSimilarly whenever I take photos in the forest they come out looking like complete garbage. It occurred to me it’s the image compression completely falling apart. Color gets totally desaturated too.
- kqr 4y agoIt's also that a forest is incredibly three-dimensional and layered, which contributes a lot to how you experience it. A photograph shows only a 2D projection of this, obviously. Capturing depth in a satisfying way in a photograph is a skill that can be learned, but often it's impossible. (The skill is really about learning to see the small set of perspectives that do translate meaningfully to a 2D projection.)
- pronlover723 4y agoI'm actually curious, many blurays I own have what seems like artificial noise added and I've wondered if that's there to hide compression artifacts.
- Scaevolus 4y agoH264 and H265 have an optional similar feature for grain synthesis, but very few decoders implement it so it's not something you'd find at the codec level in blurays. Of course, film grain is a common effect added during the editing process.
- mjevans 4y agoCan we please just get rid of the 'noise' look and embrace digital acuity already? This might be one reason I tend to prefer animated content over live action.
- gsich 4y agoFilm grain is nice and not only a technical "issue".
- pmarreck 4y ago"nice" is not a rational argument, it is a qualitative/subjective/irrational one
- gsich 4y agoTrue.
- woodruffw 4y agoThis is why I, for one, only watch movies that have no subjective quality!
- deleted 4y ago[deleted]
- have_faith 4y agoFight Club without the grain is irrational
- kennedywm 4y agoWhy is it nice? Is it that you're used to seeing it and its absence feels wrong? Wouldn't you become accustomed to its absence with exposure? I've found this to be the case for me.
- gsich 4y agoIt gives a movie texture. Compare Lord of the Rings vs. The Hobbit. Even bad (for todays standard) CGI fits perfectly vs. the clean fake looking one.
- notwokeno 4y ago>People longing for authenticity become attracted to movies shot with film >Easiest way to tell is by looking for film grain >Industry finds way to synthesize this so money can be saved on bandwidth
- jnsaff2 4y agoGenuine fake watches.
- eru 4y agoWell, everything is digital these days anyway. So all your film noise is synthesized, when you watch it over eg HDMI. The question is just how many bits per second you need.
- JKCalhoun 4y ago> So all your film noise is synthesized Strictly speaking ("film noise"), I suppose you're right. But we are all aware that there is such a thing as CCD noise, right? That's not being synthesized. I wonder if one is preferable to the other: that is, is CCD noise worse than emulsion noise? My sense is that the CCD, with the Bayer filter in place, gives you wild chroma noise while film gives more of a tonal noise.
- eru 4y agoOh, I hadn't even thought of that! Yes, digital cameras would of course not have film grain! I was making a more stupid point: these days image you are seeing on screen is always synthesized from 0s and 1s. No matter how that stream of data was original produced (ie by scanning actual film stock).
- KaiserPro 4y agothe noise floor for cameras (when working in the correct params) is ridiculously low. modern slow 35mm film (now there are loads of types and speeds) has an optical resolution of something like 5-12megapixels. a full frame CCD has easily got an optical resolution of 50mp.
- axiolite 4y agoI'm a bigger fan of just de-noising video, and leaving it gone. I don't want it replicated, UNLESS the de-noised video is such a low-bitrate blocky mess that you absolutely NEED the noise in the video to hide it. Conan The Barbarian DVD is the noisiest film I can think of off-the-top. Strong de-noising makes it look far, far better. But just about every movie out there benefits from modest de-noising.
- eru 4y agoWith this setup, you could probably just tell your decoder to skip the add-back-noise-again step?
- mrbigbob 4y agoIf youre into horror you should take a look at Hellraiser. Good god is that a noisy film. I know there are a lot of purists when it comes to film grain but that film needs some denoising applied
- knaik94 4y agoI'm not sure if it's because of growing up watching most things online with limited bitrates, but I realized I dislike film grain a lot. I know that to a certain degree, film grain helps humans resolve finer details. Similar to using noise shaped dithering to allow you to hear more than the theoretical dynamic range in audio or see a larger range of color tones in a picture. But I found that on certain 4K uhd blurays, if I am watching on a small screen the film grain looks very obnoxious. The problem doesn't exist when watching on a big TV, so I know it's not related to projecting on a screen. I really dislike when directors go out of their way to add artificial film grain. Will media players eventually allow users to adjust the film grain that is added back in? This reminds me of Steve Yedlin's, cinematographer on everything from Brick to Star Wars: The Last Jedi to Knives Out and its 2022 sequel, Glass Onion: A Knives Out Mystery, who showed through research that film can be completely emulated using digital techniques and mixed digital and film shots during Star Wars. https://www.audiocheck.net/audiotests_dithering.php https://www.audiocheck.net/audiotests_dithering.php https://www.polygon.com/2020/2/6/21125680/film-vs-digital-debate-movies-cinematography https://www.polygon.com/2020/2/6/21125680/film-vs-digital-de... https://www.yedlin.net/NerdyFilmTechStuff/MatchLensBlur.html https://www.yedlin.net/NerdyFilmTechStuff/MatchLensBlur.html https://www.yedlin.net/OnColorScience/index.html https://www.yedlin.net/OnColorScience/index.html
- MontyCarloHall 4y ago>Similar to using noise shaped dithering to allow you to hear more than the theoretical dynamic range in audio I’m not sure how apt this analogy is. Dither is only useful for mitigating artifacts of quantization noise; it does not generally increase perceived detail of any arbitrary signal. More specifically, it is introduced to reduce the harmonic content of quantization noise, at the expense of a higher overall noise floor. Suppose you have a 1kHz sine wave; quantizing it will introduce harmonics that peak at, say, an average of -70dB, with an absolute noise floor of -120dB. Adding dither will raise the noise floor to -90dB, but reduce the harmonic peaks to -100dB. So while it actually decreases the true dynamic range, it increases perceived signal quality by removing the harmonic content. These spurious harmonics occur because quantizing a signal introduces periodic artifacts. For example, suppose our analog sine wave can continuously vary between 0-7, and we quantize it to 3 bits (discrete values 0,1,2,…,7). Any analog value 4.7 will always be rounded up to 5; in a sine wave, the value 4.7 will occur periodically, thus resulting in a periodic rounding artifact, leading to harmonic distortion. In order to prevent these periodic rounding errors, dither needs to be added pre-quantization, so that 4.7 can sometimes randomly become 4.4 and get rounded down to 4 during quantization. Adding “dither” to an already quantized signal (e.g. digital video) would just make the apparent picture noisier. As a test, try quantizing a full-color image to 16 colors, and then adding back some random noise. It won’t look any better. You need to strategically dither the 16 colors with knowledge of the original full-color image.
- 1970-01-01 4y agoFrom their website: The beauty of film grain is back in the digital world. The grain will be reduced before encoding and transmitted via a grain table in the AV1 bitstream. After decoding the grain is added back and now it is possible to enjoy film look even at ultra low bitrates. This is a very subjective thing to do! I don't like it.
- eru 4y agoYou don't like the look of it? Or do you have other objections?
- vagabund 4y agoWhat's appealing about film grain isn't the grain as such so much as it is the knowledge that it's an artifact of an analog process in a world where nigh everything is digitally produced. It has a warmth that's inextricably tied to a sense of authenticity. Removing the real grain and adding synthesized faux-grain doesn't just remove that attraction, it feels actively deceptive, even if it's indistinguishable from the real thing visually.
- Vt71fcAqt7 4y agoHow is anolog "authentic?" How is anolog qualitatively different from digital from an authenticity standpoint?
- vagabund 4y agoI'm not saying it's inherently more authentic, just that that's the perception, and that perception drives part of the appeal for film grain.
- mrguyorama 4y agoBut my perception is entirely the opposite, that grain is the result of low quality film, low quality digital sensors, or a gimmick. Why should artists be targeting your perception over mine?
- user- 4y agoI wish netflix allowed you to specify that you have a beefy internet connection and to stream higher bitrate 4k. I hate watching netflix shows directly because of how crushed the blacks are. Ironically, pirated netflix shows dont have that problem.
- adgjlsfhk1 4y agoone of the things this talk mentions is that with av1, they are switching to 10 bit color which should help a lot with that.
- nwallin 4y agoDoes 10 bit color actually deliver a benefit if you have an 8 bit screen?
- thrdbndndn 4y agoYes. You can dither from 10bit to 8bit to alleviate problems like banding. (You of course can just dither it first and save the result in 8 bit in encoded result; but that would dramatically increase bitrate).
- Avamander 4y agoThanks to chroma subsampling done with most encoded content, your 8bit screen can likely display way more than the usual SDR content contains. Meaning less banding and better dark scenes.
- adgjlsfhk1 4y agoa lot of the problem with compressing dark scenes is 8 bit already is throwing away a lot of info so the compassion takes a look and figures that since there isn't a lot of info, it isn't an important part of the picture and then procedes to gut it. 10 bit color means you start off with a much cleaner image which makes it easier for the compressor to do a good job
- xmprt 4y agoNetflix doesn't give you that option because even if you have a beefy internet connection, streaming high bitrate 4k content costs them a lot too. In Netflix's case (and a lot of streaming providers for that matter), I think the bottleneck is on their side and not the viewer's.
- hellotomyrars 4y agoFilm grain that is an artifact of the recording media I think is fine, because it inherent to the media (film). Added film grain to digital to me is very dumb. It is hard for me to think that it is a strong authorial intent and not just a legacy idea that is basically assumed by default because that is how it used to be. Same thing bothers me in games. I can’t even begin to understand why someone wants film grain slapped over a game. Another reason why I think of this as an assumed convention instead of a meaningfully intended or utilized convention in modern media.
- PrivateButts 4y agoIMO grain and artifacts are a tool, like any other part of the post processing pipeline. Those tools can be abused, but they aren't valueless. I'd think that most people reach for these tools for two reasons, adding detail to bland sets, or adding authenticity to your setting. Our brains are weird and sometimes seeing less of the scene allows your mind to fill in the gaps better than the budget allows a texture artist or a set designer to do. The lack of post processing in general is what gives bad games that Unity Engine look that people hate. As for the other reason, it's sort of like how we perceive people as older due to the clothing they wear and their hair style, our cultural reference for how old a piece of media is can be tricked by the mimicking the imperfections of the filming techniques of the time. Take a photo of old brick building with a Polaroid camera and ask folks when that was shot, I would bet that most folks would say 80s or 90s more than the 2020s.
- herbstein 4y agoKnives Out is an interesting edge case there. It was shot almost completely on digital (on scene was on analog) but was post-processed by the Director of Photography to achieve the look of analog recordings. A process he has spent many, many hours perfecting. This Polygon article touches on some of the process and considerations: https://www.polygon.com/2020/2/6/21125680/film-vs-digital-debate-movies-cinematography https://www.polygon.com/2020/2/6/21125680/film-vs-digital-de...
- KaiserPro 4y agomost film grain since the mid 2000s has either been fake, or augmented. Anything that went through a VFX pipeline was denoised (so that trackers, painters & rotoscoper can work more efficiently.) once the effects applied, then film grain was put back in. (even if it was to be lasered back out onto film.) Film stock improved significantly from 2000 to maybe 2008. grain getting smaller. optical resolution getting better. (well maybe digital intermediary got better.)
- Animats 4y agoFirst you take video with no grain artifacts. Then you use something like Filmlook to add grain. (Dust and scratches are optional.) Then, in preparation for transmission, you remove the grain, characterize it, and transmit grain statistics to the receiver, which re-inserts fake grain. Grain is probably something that will disappear in a few years as the old film-oriented directors die off. Along with 24FPS.
- nwallin 4y ago> Along with 24FPS. 24FPS is gonna stick around for a while. I've not seen any high framerate movies that didn't make the movie set look like a...movie set. This is great for sports and documentaries where a better visualization of the subject is always better, but in movies it just makes everything look like it was manufactured as quickly and as cheaply as humanly possible--because it was. I feel like high framerate, even more than 4k, lets you "see" the set and the makeup and the props as a hastily crafted illusion. Everything looks fake. Even the body language looks like acting in high framerate. Meanwhile, in sports and documentaries everything looks more real, because it is real; there's no set, no props, no act--well less acting. More acting in soccer. I'm sure at some point in the future set designers and the props departments and all that will figure out how to make 48FPS and above look good, but we don't live in that future yet.
- Animats 4y ago> but in movies it just makes everything look like it was manufactured as quickly and as cheaply as humanly possible That happened when HDTV came in. Sets that looked OK at 525 lines and NTSC color looked terrible at 1080 lines and hard-edged color.
- KaiserPro 4y ago> Grain is probably something that will disappear I doubt it. Oil paints are still here, even though digital painting is easier and quicker. > Along with 24FPS. 24fps is film. 24fps will not die in our lifetime. In the same way that vinyl records are still here and thriving, despite being a shite medium. 24fps I suspect will be displaced by some sort of VR as the predominate high-end story medium.
- tgsovlerkhgsel 4y agoThis sounds like they're taking the source material, removing the film grain artificially (which must degrade the data a lot), then re-adding it. It's interesting that they aren't starting from a grain-free version - at least for new productions that should be available.
- slhck 4y agoMany productions specifically want film grain. Directors and DPs have very concrete aesthetic intentions when they go for film grain, so you're likely to find lots of movies with film grain added in post when they were shot on almost noiseless digital cameras. (For instance, one might scan the grain from an old film stock and apply it to the digital footage later.) Netflix is only optimizing the pipeline here, trying not to mess with the artistic intent.
- tgsovlerkhgsel 4y agoI understand that. I would expect Netflix to tell the production crew "I want the film grain on a separate layer so we can apply it after compression".
- slhck 4y agoThat would make sense. Just like some overlays could be added later.
- rperez333 4y agoThey are starting for a very good source material, but it still grainy - even from highend digital cinema cameras.
- slhck 4y agoHigh-end digital cinema cameras are not _that_ grainy per se. The sensors are very clean. The level of grain you get from digital cinema photography is mostly by artistic choice and added through the camera or in post production. Sometimes the movie is shot digitally and transferred to film, then scanned. This was done for Dune (2021), for instance. Also, ARRI (who make the most renowned cameras for cinematic use) now specifically let you choose a grain texture on the Alexa 35 that is imprinted in the digital material. [1] [1]: https://www.arri.com/en/learn-help/learn-help-camera-system/image-science/textures https://www.arri.com/en/learn-help/learn-help-camera-system/...
- _cenw 4y agoWeirdly enough my first thought was that they could just put the equivalent of printer dots in the output to track who creates web rips.
- knaik94 4y agoThat wouldn't scale because each new set of printer dots would require a complete re-encode. You can find raw rips on the high seas, so anything less than hard-coded dots would just get stripped anyway. If you take rips from two sources, you could also just subtract one identical frame from another to isolate the dots and remove them.
- slhck 4y agoThis article is not very informative. The referenced video is a couple of years old — this is all not news. I think this article is just a plug for the company website and should be removed from HN.
- hackerman123469 4y agoI know this is a little off-topic, but I would like to say that I read "Netflix: 30% birthrate saving" and was very confused at first.
- fmajid 4y agoHipsters and their so edgy film grain, which is mere filter effect away.