4 ms·
> You can't get information out of SD video that wasn't there before with upscaling, so the algorithm is just interpolating. In the fully general case of arbit
by rictic 8y ago
> You can't get information out of SD video that wasn't there before with upscaling, so the algorithm is just interpolating.
In the fully general case of arbitrary video this is true, but in practice it isn't.
You can gather information over time to do superresolution, and if you want to get super fancy you can build a world model (e.g. get more information about what an actor's face looks like from a close up shot, and apply that knowledge to less detailed shots).
I expect ML based upscaling to eventually produce some truly stellar results.
- basch 8y agoa combination of a world model, along with non-source enhancements. i imagine upscaling the Phantom Menace podrace to 4k, and giving the model a bunch of NEW rock texture info to use to create new detail. Kinda of an automated way to combine these two ideas. http://www.framecompare.com/image-compare/screenshotcomparison/JCNNN8TU http://www.framecompare.com/image-compare/screenshotcomparis... https://techcrunch.com/2019/03/18/nvidia-ai-turns-sketches-into-photorealistic-landscapes-in-seconds/ https://techcrunch.com/2019/03/18/nvidia-ai-turns-sketches-i... What you dont want is every upscale to start looking homogeneous, so it would be best for a design team to specifically map old to new texture sets, giving each upscale a unique look.
- ocdtrekkie 8y agoI was thinking particularly about the space battle shots, where you could provide 3D models of each of the ships, so that the software had the higher detail information, and would just need to match position, movement, and lighting.
- tracker1 8y agoI would expect multi-view rendered models of ships/stations etc to also help significantly as well... vs. re-rendering sfx, it would be upscaling via AI with knowledge of detailed views/models for the actors... training stills could go a significant way.