6 ms·
Firefox brings smooth video playback with the fastest AV1 decoder
- shmerl 7y agoOn Linux Firefox suffers from lack of hardware decoding and encoding (it doesn't plug into vaapi), which makes performance quite bad on laptops. I suspect something like WebEx, for example, works horribly in result. Or may be it's just Cisco not doing a good job. Conferencing experience with their WebRTC client in Firefox on Linux is horrendous.
- kvark 7y agoWe were just talking about VA on Linux. There is a chance for it to be enabled soon.
- shmerl 7y agoOh, that's great to hear! I thought this might come into focus, once WebRender is officially released. By the way, how is the progress for WebRender over Vulkan?
- kvark 7y agoCurrent state of Vulkan port is that the correctness is on par with GL, minus a few driver bugs. We still need to re-architect WebRender a bit in order to get the performance advantage over GL.
- AngryPenguin 7y agoSo VAAPI support can soon land in Firefox for Linux? Cool. This is great news for me. Can you give us some details? When? Can I somehow help in testing, for example in Firefox nightly? What hardware can be supported? What formats, h264 or/and vp9?
- kvark 7y agoWe can't promise anything yet, sorry, but we are looking into it.
- mackal 7y agoI just switched to Firefox again after some shortsighted changes on Chrome. Neither give me GPU decode on Linux, but FF is SIGNIFICANTLY worse than Chrome on CPU decode. I can do a build in the background using all 12 threads and have no issues with video play back on Chrome (well, maybe not 4k60) but FF it's unwatchable, even at 900p60. (i7 8700k if you're wondering hardware wise, not OC'd because horrible chip and not worth it)
- Naac 7y agoThe bug report is 4 years old: https://bugzilla.mozilla.org/show_bug.cgi?id=1210726 https://bugzilla.mozilla.org/show_bug.cgi?id=1210726 It's such a disappointment that this hasn't been fixed yet.
- shmerl 7y agoSeems to be limited to playback. Encoding is probably more critical for this.
- AnaniasAnanas 7y agoSadly Linux has been a 3rd class citizen for years as far as Mozilla is concerned.
- Jonnax 7y agoOr maybe it's a complex engineering challenge? The Firefox Devs aren't just sitting there not clicking a button called "enable hardware acceleration"
- techntoke 7y agoWell at least Chromium has support for this. I don't know why it is taking Mozilla so long honestly, but I'm guessing most of their developers don't use Linux and the org just loves to virtual-signal and not practice what they preach.
- bwat49 7y agogoogle refuses to support this on desktop linux though, it requires a patched chromium build. The only reason vaapi support is there at all is because their chromeOS uses it.
- techntoke 7y agoI used Chromium and it is very easy to use on Arch. Not sure why you act like it isn't supported. A lot more than what is available for Firefox.
- afranchuk 7y agoFWIW I've never had an issue with WebEx on Linux Firefox (besides general WebEx UI/UX things).
- shmerl 7y agoDoes it work for conferencing too? I often get "low bandwidth / low CPU" warning and no video feed, despite having quite good hardware. The more people are in the room - the worse (it's as if instead of multiplexing on the backend, it tries to multiplex on the client side). Very annoying.
- Boulth 7y agoFor me appear.in worked perfectly in conferences and AFAIK it uses plain WebRTC.
- enz 7y agoIt's weird, my Firefox seems to use the vaapi (but my iGPU is only able to hw-decode h264 and VP8 and VP9.Too old for AV1.) I have a not so powerful laptop so I think the HW decoding capability of the iGPU is actually used, otherwise I couldn't play 1080p videos at 60 FPS (h264 and VP9). I use the static Firefox from Mozilla. Not distro repo's one.
- Boulth 7y ago> It's weird, my Firefox seems to use the vaapi Out of curiosity how do you check that? I'm asking because I'd like to check it on my end.
- enz 7y agoI am checking that with the "about:support" page. My iGPU and the Intel drivers are correctly recognized so I was assuming that HW decoding was enabled. But I can certainly be wrong, good platform detection does not necessarily mean that I use HW decoding. I just assumed it was the case.
- i-rinat 7y agoNope. It's just software decoders from FFmpeg project that are heavily optimized. Also Firefox disables VP9 on slower machines, so websites serve H.264 instead.
- enz 7y agoAt least on YouTube, I use VP9 (we can check that with the "advanced stats" showed when right-clicking on the video). My laptop is usually noisy when the CPU is in demand. I am a bit surprised because playing HD videos on YT does not make the fan too noisy (comparing to loading a website with a ton of JS,for example). So, I concluded that some HW decoding was in use, somehow. I can, of course, be wrong. There is no way that ffmpeg uses a HW decoding decoder under the hood? It may explain why it's so smooth. Besides, when I run VP9 video with MPV, it tells me that it is explicitly using HW decoding via vaapi. And MPV is based on ffmpeg libs for the playback, if I am not mistaken. Thanks for your light!
- w0utert 7y agoOn the one hand this is great, it's hard to argue that it isn't a good thing to have a very fast CPU-based AV-1 decoder built into Firefox. On the other hand, I'm wondering how long this decoder will be relevant, especially considering it could still take a while before AV-1 video will be widespread on the web. I fully expect everyone and the kitchen sink will have hardware decoding before long, which is vastly superior over any software implementation.
- Veedrac 7y ago> our latest figures showing that 11.8% of video playback in Firefox Beta used AV1 It seems remarkably popular already.
- acdha 7y agoYouTube started testing AV1 - I would not be surprised to learn that’s most of that number alone. Video format market share is tricky to measure because just a few sites like YouTube, Netflix, Vimeo, Twitch, etc. represent a huge fraction of the total streaked bandwidth even though there are so many other sites which publish video on the web.
- ehsankia 7y agoYeah, last I remember, Netflix and Youtube alone use something like 50% of the internet's entire bandwidth. Video is pretty data heavy though so I'm sure there's a huge push to switch to something more efficient.
- sjwright 7y agoThat hardware decoding is more important and will become prevalent sooner on mobile. This will allow early adopters and video producers to validate their content. It will also allow people in five years who have a 5-year-old desktop to enjoy the content.
- adrianN 7y agoPeople don't upgrade their hardware as often as they used to. For example my main machine is nearly ten years old at this point.
- newsoul2019 7y agoWhy isn't there a sample?
- clouddrover 7y agoTry it on YouTube. Turn on AV1 via TestTube: https://www.youtube.com/testtube https://www.youtube.com/testtube Try the AV1 test playlist: https://www.youtube.com/playlist?list=PLyqf6gJt7KuHBmeVzZteZUlNUQAVLwrZS https://www.youtube.com/playlist?list=PLyqf6gJt7KuHBmeVzZteZ... And you'll find many other YouTube videos encoded in AV1 up to 720p. Try popular music videos or movie trailers for examples. Check that it's AV1 by right clicking on the video and selecting Stats for Nerds.
- clouddrover 7y agoAV1's been making good progress in Firefox. This 1080p60 video has gone from being essentially unplayable in AV1 to now being almost perfect on my 5-year old, AVX2 enabled laptop in Firefox 68 beta: https://www.youtube.com/watch?v=Fmdb-KmlzD8 https://www.youtube.com/watch?v=Fmdb-KmlzD8 My system consistently drops frames at the point the jeep drives up the hill and then recovers for the remainder of the video. Other than that it's fine. You can enable AV1 on YouTube via TestTube (https://www.youtube.com/testtube https://www.youtube.com/testtube) and you can check if a video is in AV1 via right clicking on the video and selecting Stats for Nerds. If it's AV1 the codec will be "av01".
- vitorgrs 7y agoHere on Firefox it just goes up to 480p...
- SimeVidas 7y agoI’m not sure if it’s because I’m on Firefox Nightly, but I get 1080p@60. Proof: https://i.imgur.com/JoT2wsM.png https://i.imgur.com/JoT2wsM.png.
- vitorgrs 7y agoNot doubting you. I guess is just some hardware detection? Or don't know... https://imgur.com/a/8nTkQEj https://imgur.com/a/8nTkQEj
- callahad 7y agoDoes anything seem amiss at https://www.youtube.com/html5 https://www.youtube.com/html5?
- vitorgrs 7y agoJust WebM VP8 and MSE & WebM VP9
- Sami_Lehtinen 7y ago
- skunkworker 7y agoWith Firefox 67 on a quad core Mac I'm getting solid video playback on AV1 on Youtube 1080p If you want to test this right now, here is how to enable AV1 in Youtube and test videos. Goto the youtube testtube page and click "Always Prefer AV1" https://www.youtube.com/testtube https://www.youtube.com/testtube AV1 Beta Launch Playlist https://www.youtube.com/playlist?list=PLyqf6gJt7KuHBmeVzZteZUlNUQAVLwrZS https://www.youtube.com/playlist?list=PLyqf6gJt7KuHBmeVzZteZ... And click "stats for nerds", if it's working it should show "av01" under the Codecs tab. https://i.imgur.com/eKTFaYU.png https://i.imgur.com/eKTFaYU.png
- rutierut 7y agoThanks, I used the Halo video[0] to compare, a couple of notes. - Youtube seems to have limited the AV1 support to 1080p, 1440/2160p are not available, anyone any idea why? - The load on my CPU (MB Pro 2018 quad-core/ FF DE 67.0b9) seems about the same but I do seem to be dropping significantly less frames, not sure though. [0] https://www.youtube.com/watch?v=Fmdb-KmlzD8&list=PLyqf6gJt7KuHBmeVzZteZUlNUQAVLwrZS&index=6 https://www.youtube.com/watch?v=Fmdb-KmlzD8&list=PLyqf6gJt7K...
- chupasaurus 7y ago> Youtube seems to have limited the AV1 support to 1080p, 1440/2160p are not available, anyone any idea why? They probably don't reencode 1440+p (there are 8K videos too) in AV1 as of yet.
- lousken 7y agoit was probably encoded at a time when they didn't do 4k av1 tests but only 1080p, but since then they also did a 4k one if you wanna test it https://youtu.be/LXb3EKWsInQ https://youtu.be/LXb3EKWsInQ
- eridius 7y agoNo mention of power efficiency though. Hardware decoders are good for more than just performance.
- fireattack 7y agoWish they could fix full-range video (for any format) playback first :/
- kevingadd 7y agoI've filed bugs about this before, part of the problem is that every node in the chain needs to handle video ranges correctly. Once you introduce hardware decoders you can be in bad shape here because the range becomes a guess. Depending on which GPU vendor you have and what OS you're on, there may be a system-wide default output range (and a separate default for videos without range information), and the range assumptions may depend on application. If you use nerdy video compositors like madVR you can get them to tell you how much info they have on video ranges, and in many cases the answer is 'none' so they guess. At least on Windows, it is a fact that some of the range issues are not under Firefox's control, because some of this stuff is delegated to the decoder and to the video driver. (You can configure it in NVIDIA's Control Panel application, fwiw.) In practice people seem to solve this by just using limited range all the time because it's much better to have limited range content displayed without expansion than to have full range content erroneously limited->full expanded and have a bunch of the range destroyed. If you try to stream to Twitch, for example, they tell you to use limited range, and it will look VERY bad in most players (not just Firefox!) if you disregard the advice. I've also had problems with full range uploads to YouTube that can't be attributed to Firefox. EDIT: Checked my bug history. For the NVIDIA + Windows + Firefox combo, here is the workaround for range issues along with an explanation of why Mozilla has no way to fix it in this scenario. https://bugzilla.mozilla.org/show_bug.cgi?id=1229304#c8 https://bugzilla.mozilla.org/show_bug.cgi?id=1229304#c8
- fireattack 7y agoFirefox does not support full-range video at all, even with software decoding. See bug ticket: https://bugzilla.mozilla.org/show_bug.cgi?id=1459526 https://bugzilla.mozilla.org/show_bug.cgi?id=1459526 Or just test this: https://bug1459526.bmoattachments.org/attachment.cgi?id=8984703 https://bug1459526.bmoattachments.org/attachment.cgi?id=8984... Firefox's video support in general is pretty poor compared to Chrome. It doesn't support RGB or 4:4:4/4:2:2 YUV video either. >here is the workaround I knew that bug too, but that's a different story. That is about Firefox having problem to playback limited range video properly with nV graphic card (and it's partially nVidia's fault than Firefox). Chrome used to have that bug too, but they have fixed it. (Firefox team on the other hand, didn't plan to fix it for Win7 at least: https://bugzilla.mozilla.org/show_bug.cgi?id=1410693#c1 https://bugzilla.mozilla.org/show_bug.cgi?id=1410693#c1 ).
- jl6 7y agoHas anybody published an analysis that clearly demonstrates AV1’s compression efficiency over HEVC? I’ve seen claims of benefits, and analysis versus h.264, but not the clear evidence that HEVC is going to become obsolete.
- clouddrover 7y agoHere's one. See the "High Quality (AV1) Report": http://www.compression.ru/video/codec_comparison/hevc_2018/ http://www.compression.ru/video/codec_comparison/hevc_2018/ As for HEVC's obsolescence, Leonardo Chiariglione, founder and chairman of MPEG, thinks AV1 has the bigger future because HEVC's licensing is too messy: http://blog.chiariglione.org/a-crisis-the-causes-and-a-solution/ http://blog.chiariglione.org/a-crisis-the-causes-and-a-solut...
- kirvyteo 7y agoAny updates on the free hw decoder by Google? I am hoping to test it on a FPGA (if possible)
- whereareyouwow 7y agoAbout half of the frames get dropped for me. https://i.imgur.com/MeLQXST.png https://i.imgur.com/MeLQXST.png
- lousken 7y agostill can't get smooth 4k60fps vp9 playback when using speed more than 1.5x on youtube, meanwhile in chrome it works fine
- cptskippy 7y agoI know you're serious but it's hard to take that complain seriously.
- lousken 7y agoI mean it's the only way u can watch steve from gamers nexus without falling asleep from his voice, great content otherwise...
- cptskippy 7y agoI don't need to see Steve in 4k60fps though... I mean his hair flips are epic and all but still.
- lousken 7y agoTrue, but if I am watching videos I'm feeling lazy and I shouldn't have to turn down resolution just for his videos because they're in 60fps instead of 30 when in Chrome it works fine (I'm using tampermonkey script which switches all videos to the highest resolution with 4k as a limit).
- teilo 7y agoSo this basically brings Firefox on par with Chromium, which was already using dav1d?