14 ms·
Nvidia’s latest GPU drivers can upscale old blurry YouTube videos
- jjbinx007 4y agoI've just tried this and I can't tell any difference. Could it be because my laptop has an Intel and an nVidia 3060 I wonder?
- SketchySeaBeast 4y agoFrom what I can see on Reddit it's just not working for some people - I can't see the difference on my desktop no matter what I try. You need to set the video source lower than your monitor resolution and possible set chrome to high power mode (details here: https://nvidia.custhelp.com/app/answers/detail/a_id/5448 https://nvidia.custhelp.com/app/answers/detail/a_id/5448). Maybe that'll help you - it hasn't for me.
- ChrisRR 4y agoHave you tried this? > To enable it, launch the NVIDIA Control Panel and open “Adjust video image settings.” Check the super resolution box under “RTX video enhancement” and select a quality from one to four — ranging from the lowest impact on GPU performance to the highest level of upscaling improvement.
- jjbinx007 4y agoYes thank you, I did try that. I can enable it and turn it from 1 to 4 but I wonder if it's because Chrome and Edge are both using my Intel GPU by default.
- jayd16 4y agoI tried it on my Ryzen laptop and was able to work. You need to use 360p video and apply the settings and then restart the video for it to kick in. To really tell a difference, you'll want to compare screen captures.
- nijaru 4y agoI had to turn it on manually under Nvidia control panel. My GPU used roughly 100W more while playing a video on any of the super resolution settings, so it is definitely working when turned on. I didn't do rigorous testing of video source quality though. The idea is cool, but I'm going to leave it off since I don't think I'll get much benefit out of it.
- gtirloni 4y agoOfficial article is more useful: https://blogs.nvidia.com/blog/2023/02/28/rtx-video-super-resolution/ https://blogs.nvidia.com/blog/2023/02/28/rtx-video-super-res...
- dang 4y agoOk, we've changed to that from https://www.theverge.com/2023/2/28/23618245/nvidia-rtx-video-super-resolution-upscale-videos-rtx-gpu https://www.theverge.com/2023/2/28/23618245/nvidia-rtx-video.... Thanks!
- interestica 4y agoCan you have some sort of bot do comments like these in a thread as a sort of changelog? Sometimes comments are referring to a previous link or a previous headline.
- arprocter 4y agoI considered submitting that instead, but unless you already know what "RTX Video Super Resolution" does the headline is less descriptive
- sys32768 4y agoI wonder whether this will work on uncompressed video such as .AVI or .MOV? I have some HD 8mm transfers that I would like to try out 4k on.
- RajT88 4y agoI would love to use this to make more watchable some of the weird crap from the 70's I have kicking around on my NAS. My favorite and weirdest thing from the 70's, which is only available as barely-watchable youtube vids: https://www.imdb.com/title/tt0078697/ https://www.imdb.com/title/tt0078697/
- MikusR 4y ago.AVI or .MOV are containers and can contain many different things. But to answer you. Here is a renderer with instructions for mpc. https://github.com/emoose/VideoRenderer/releases/tag/rtx-1.0 https://github.com/emoose/VideoRenderer/releases/tag/rtx-1.0
- freedomben 4y agoI've been blown away at the AI upscaling on the Nvidia Shield. On my fairly large 4K TV, the Shield can produce picture quality that looks incredible out of source that isn't all that great. On that note, the Shield has been an unexpectedly great purchase over the years. Long life of support from Nvidia, runs Google TV, works incredibly as a gaming console for Steam Linking into my PC and/or playing compatible Android games, and hosting a Plex server (although I now use Jellyfin hosted on a raspberry pi). If Nvidia would open source their Linux driver (or at least drastically improve support), I'd be a huge fan. I highly recommend, despite the fact that I'm mad at them for the pain they cause me on Linux. Buy AMD cards if you run Linux).
- netruk44 4y agoI also have an Nvidia shield that now sits unused for the simple reason that Google forced ads onto the home screen. It used to be that the Shield was the one bastion away from ads on Android TV, then with one update that somehow manages to reinstall itself despite being completely disconnected from the internet, there are now permanently ads on my Nvidia Shield TV. I honestly don't know why it's such a big deal for me, but I basically never use it anymore. It's real shame, I got a lot of good use out of it, because as you mention the support has been going on for years now. But I will not subject myself to ads if I can help it. I pay for Youtube to avoid ads, I pay for Twitch to avoid ads. I can't pay to remove ads from my Android TV homescreen (that I didn't even have for the past like 5 years)
- verall 4y agoIt is possible to plug your shield into your PC and sideload a new launcher which doesn't have ads, it's not too difficult (tho installing adb is a hassle). I heard on reddit that if Nvidia even hints that this is possible, they violate the license agreements with Google, and then Google is allowed to yank the play store...
- freedomben 4y agoDo you know if it has to be plugged in to sideload a launcher? I sideload apps through wireless adb and it was pretty easy to get set up.
- bee_rider 4y agoOld games like Quake always look pretty janky when upscaled (extreme example of course). The low-poly models seem to become worse the closer you can look at them. I wonder if there’s a level of detail that just fundamentally can be upscaled indefinitely and end up vaguely “looking right”, or if it is just the case that something like Apex Legend was release recently enough that the lift is not so huge.
- Gordonjcp 4y agoMaybe the "upscaler" just needs to be a really good CRT emulation.
- omeze 4y agoYea, was gonna say that CRTs basically gave hardware-level anti-aliasing to every game for free. Playing the same games on an LCD TV makes them look strange and jagged edges stick out a lot more.
- bick_nyers 4y agoCRT also gave extremely high smoothness for free. 60Hz there looks a lot better than on LCD etc.
- Gordonjcp 4y agoThat's down to the longer persist. LCD goes on and off (almost) instantly, CRTs have a certain amount of "persist" where the phosphor glows for a moment after the beam has left it. It's also (kind of) why interlacing worked, when black-and-white CRTs had a persist about as long as one field. This would make fast action a bit more "smeary" though, and you can think of its effect as similar to a wider "shutter angle" in a camera.
- nyanpasu64 4y agoFrom online reading and my personal observations, CRTs have lower phosphor persistence than LCDs, resulting in both the flicker and clearer motion. I think interlacing works more due to persistence of vision, and because the beam is thick enough to nearly fill the scanline gaps. You can actually simulate interlacing on a LCD by showing simulated scanlines, alternating by half a line each field/frame. There's a video demonstration at https://youtu.be/tS0cFwvDWkE?t=480 https://youtu.be/tS0cFwvDWkE?t=480.
- ikekkdcjkfke 4y agoBad on youtube for down scaling old videos
- mrguyorama 4y agoI have watched 3kliksphilip and LinusTechTips demo video upscaling AI stuff, and it always looks really really weird and gross. It seems really unnatural, and has the same kind of "nope that's wrong" as if you maxed the saturation on the photo. It feels more like a highschooler touching everything up in photoshop than correctly understanding what the objects in the video should look like. Also, in their recent demo of a video upscaling technology, Nvidia clearly kneecapped the pre-upscale footage to make it seem like the upscaler was doing more than it actually was. If you take the source video they were using and convert it using settings they claimed they were using for a low bitrate version, you get a much clearer and cleaner video than they showed.
- smoldesu 4y ago> Nvidia clearly kneecapped the pre-upscale footage I'm not so sure. High bitrate content like game streaming does end up losing visual quality with lossy encoding. The average 1080p Twitch stream struggles to look as clean as Nvidia's 1080p source footage. Given the circumstances, I think this is a great option. Most videos don't look right when encoded on YouTube or blown up at 2x resolution. A destructive AI pipeline is your best shot at reducing the destructive artifacting introduced at the encoding stage.
- Hellmitioksldf 4y agoThis news is still something to celebrate as it shows the way forward. The information is in the video files and our brain can't just use it but math can. I can imagine using/buying a upscale model optimized for an old tv show for example. Or using a model for my prev game streams. There is temporal information and high res pictures from sets, styles or actors at the time of the recordings. All information which can be used. If its not yet good enough, it will. Lets see if this forces a global standard or opensource model plug and play or whatever. And if you look at the other nvidia research like were the model learns the face and than interpolates all further movements also a really good use case.
- whydid 4y agoIs it possible to process my own videos with this? Is there a python/cuda API?
- crtasm 4y agoIs it handled by a browser extension? Curious if it might be hacked into Firefox. There's a suggestion to add "AMD FidelityFX or similar technology" here: https://connect.mozilla.org/t5/ideas/video-upscaling-in-browser-video-players-using-amd-fidelityfx-or/idi-p/15928 https://connect.mozilla.org/t5/ideas/video-upscaling-in-brow...
- xeromal 4y agoI'm using it right now and I didn't install an extension. I believe it's baked into Chrome. It required a chrome update to work.
- DaleCurtis 4y agoIt's a plug-in to the Windows ID3D11VideoProcessor API, https://source.chromium.org/chromium/chromium/src/+/main:ui/gl/swap_chain_presenter.cc;l=267;drc=c8862ddf4408008bc14261694f19b5dbd06309ac https://source.chromium.org/chromium/chromium/src/+/main:ui/...
- dschuetz 4y agoCurrently only supported by Chrome and Edge. Other Chromium-based browsers seem not to be supported yet (e.g. Vivaldi). Firefox is probably not (yet) supported at all. Checked on Vivaldi and Edge with the Revolution OS video on Youtube.
- Wilkolicious 4y agoWorks on Brave for me.
- dschuetz 4y agoOh yeah, just updated Vivaldi et voilá! AI artifacts in blurry videos! xD
- BugsJustFindMe 4y agoWill this also fix how youtube always starts high res videos at the lowest resolution making them look like crap until you manually reset it?
- glenneroo 4y agoPerhaps this[0] plugin will help? It's only for Firefox but I'm sure there are equivalents for other browsers. You can set a plethora of options, including auto-selecting playback quality of videos, playlists, pop-up players, embedded videos, when in full-screen mode and more. [0]: https://www.mrfdev.com/enhancer-for-youtube https://www.mrfdev.com/enhancer-for-youtube
- addandsubtract 4y agoI've been using this extension for years and consider it a must-have. It turns the hot mess that YT has become into a decent experience. The site says it's available on Chrome and Edge, as well.
- brokenmachine 4y agoI know this might be an odd request but does anyone know if there's a way I can get youtube into a view mode where it makes the video as wide as the screen but I can still scroll the comments below, without scrolling the video off-screen? Like "Theater Mode", or even the default view, but the video stays fixed and the rest of the page scrolls. I don't like the popup player. I use Firefox if it makes a difference.
- TheAceOfHearts 4y agoIt would be cool if there was a way to upscale old Brood War videos to look as if it was being played on the new Remastered edition. I'm not sure if the technology is quite at that point yet, but it seems like an increasingly tractable problem.
- bick_nyers 4y agoI think the likely avenue there would be using something similar to Stable Diffusion to perform style transfer. You may not need to SD for every frame if you can intelligently generate sprites that can be re-used. We are getting there
- berjin 4y agoIt doesn't make much economic sense for millions of people to upscale vs YouTube doing it once and storing the output.
- _joel 4y agoCourse it does, they don't need to run the upscale job, don't need to store it, get to sell more hardware. Maybe not for the user tha pays more to upscale through having to buy hardware or pay extra for electricity (minimal but still). At least they save on they b/w :)
- megablast 4y agoThis is the opposite of economic sense. Store 99% of video that people watch less than a few times a year. Those people upscale.
- remus 4y agoI think you would need to understand in some detail the makeup of all the content on YouTube before you can make that choice. As a hypothetical example, say yt had one user and 1 billion years of video. It makes a lot more sense for that one user to do up scaling than it does for yt to transcode all that video. The reverse is also true i.e. 1 video, 1 billion users = yt should do a lot of transcoding. The real solution (in the economic sense of minimising overall cost) is probably a compromise where yt transcode their most popular content, and if you're interested in the long tail of unpopular content then you can invest in upscaling.
- jzombie 4y agoCurious about the eventual usage of this in WebRTC.
- litiholofan 4y agoIt is interesting that youtube is silently removing the ability to watch old videos in HD after making it difficult to sort by oldest on a channel. I have videos uploaded in 1080p 5 or so years ago now only giving the option to watch in 360p. Anyone else notice this?
- noitpmeder 4y agoI guess it's not exactly shocking... what better way to reduce their storage requirement than to downsample old and not-frequently-watched content. I bet 95%+ of videos on the platform fall into this bucket.
- litiholofan 4y agoNotification of this fact by youtube would've been nice to be honest - and perhaps a way to pay to keep them in high quality.
- samtheprogram 4y agoHighly unlikely, we’re talking about Google here.
- b112 4y agoOne day, the future may regard YouTube, as BBC, who recycled and overwrote Dr Who tapes to save a few bucks. And lost handsomely as a result.
- wackget 4y agoAre there any software solutions for upscaling content on-the-fly as you watch it in a media player like VLC or MPC-HC? Most televisions nowadays have built-in upscaling so you'd think something would exist for the desktop PC market.
- samplatt 4y agoMost televisions only render at one resolution; they don't have the ability to dynamically resize the "window" of the player. I've always just assumed upscaling on the TV is just the same as fullscreening VLC on a large monitor.
- tehnub 4y agoFor VLC I don't know, but with MPC-HC you can use madVR [0]. My preferred setup is mpv [1] with a few shaders [2] such as FSRCNNX [3] and Krig Bilateral. [0]: https://madvr.com/ https://madvr.com/ [1]: https://mpv.io/ https://mpv.io/ [2]: https://github.com/mpv-player/mpv/wiki/User-Scripts#user-shaders https://github.com/mpv-player/mpv/wiki/User-Scripts#user-sha... [3]: https://github.com/igv/FSRCNN-TensorFlow/releases https://github.com/igv/FSRCNN-TensorFlow/releases
- MikusR 4y agohttps://github.com/emoose/VideoRenderer/releases/tag/rtx-1.0 https://github.com/emoose/VideoRenderer/releases/tag/rtx-1.0
- megablast 4y agoThis must be such a easy network to train. Get high res video. Down sample it. Add artifacts. Train the network.
- dusted 4y agoOh god no.. Hopefully it does not become some default behavior in the hardware accelerated decoder.. or even worse, a.i. based codecs.. It's great until it's not.. If I must chose between a blurry video where I don't know what some detail is, or a sharp video where I don't know if some detail was actually there, I'll go with the blurry one thanks.
- rldjbpin 4y agoput a big * in the title: *for those with RTX cards. also funny how this is out while youtube is rolling out higher bitrate videos.
- MikusR 4y agoPut a big * to "youtube is rolling out higher bitrate videos" *for those that pay.