15 ms·
Upscayl – Free and Open Source AI Image Upscaler
- esafak 3y agoWhat's the state of the art?
- liuliu 3y agoSUPIR and other diffusion based models.
- NayamAmarshe 3y agoBut doesn't that defeat the purpose of upscaling? I see a lot of people promoting Magnific AI (which costs $40 a month) but it's not really an upscaler. It's more of an AI repainter. It replaces most details by re-imagining them instead of guessing the original details. I think we should be clear about what an AI Upscaler is and what an AI re-painter is.
- liuliu 3y agoESRGAN is the same thing. You cannot recover signal that are already lost without additional information (in Diffusion case, model's prior). Upscaler are hallucinators by that definition.
- wruza 3y agoBut results differ in perception. ESRGAN doesn't hallucinate whole [sub]objects and that puts it into a different category. Latent/denoising i2i re-scale is different because its parameter range doesn't really intersect with what ESRGAN does.
- cchance 3y agoIt can only hallucinate if your i2i noise level is high enough, if you're adding enough noise that the latent is basically filling in giant swaths of noise areas then of course its going to make up new stuff, thats not hallucinations as much as you asking the AI to draw that entire area as something new.
- liuliu 3y agoWhat @cchance said. Also, Diffusion models have much more capacity than ESRGAN. Unable to hallucinate whole subjects is a limitation of model capacity and training data, not the reverse (i.e. a high capacity model can mimic what you want in a low capacity model if you steer it the right way). An unsuspicious drop of water can have a whole world inside it under a microscope.
- amelius 3y agoOK, but I do hope that the hallucinations disappear when you downscale (normal resize) an upscaled image (?)
- cianigga 3y ago[dead]
- wruza 3y agoIf like me you're using Real-ESRGAN-ncnn-vulkan [1] and are curious what upscayl-ncnn CLI [2] changed from it, there's not much and nothing substantial [3]. Not a criticism, just wanted to learn whether it's worth upgrading to for a CLI tool ($subj is a separate GUI app based on it). [1] https://github.com/xinntao/Real-ESRGAN-ncnn-vulkan https://github.com/xinntao/Real-ESRGAN-ncnn-vulkan [2] https://github.com/upscayl/upscayl-ncnn https://github.com/upscayl/upscayl-ncnn [3] https://github.com/xinntao/Real-ESRGAN-ncnn-vulkan/compare/master...upscayl:upscayl-ncnn:master https://github.com/xinntao/Real-ESRGAN-ncnn-vulkan/compare/m...
- pluto_modadic 3y agoI mean... if people prefer a GUI that's not a bad thing...
- amelius 3y agoEspecially for something involving graphics.
- NayamAmarshe 3y agoUpscayl NCNN has several fixes (like latest vulkan, bug fixes, feature additions) and is coming up with more soon (we just haven't pushed the changes). Also working on CPU support. If you're going to use Real-ESRGAN, you're going to have to deal with a lot of issues and a codebase that hasn't been updated in a long time. Afaik, Upscayl NCNN is the only project maintaining Real-ESRGAN NCNN as of now.
- wruza 3y agoI've only used -i -o -n mode, but for me that just works. And when something just works, I tend to see "a codebase that hasn't been updated in a long time" as a good thing generally :) (Don't take it personally, it's my burnout from modern software cycles.)
- NayamAmarshe 3y ago
- graevy 3y agoupscayl is very approachable, but lacked many features i needed. i ended up using https://github.com/AUTOMATIC1111/stable-diffusion-webui https://github.com/AUTOMATIC1111/stable-diffusion-webui after upscaling became part of my regular workflow, but for someone who just needs a few images enhanced, it's an ideal tool.
- zebomon 3y agoI tried this out back in December. It is very straightforward. Would recommend for anyone who is testing the waters and just trying to start exploring the various tools. From my understanding though, the quality is pretty far behind that of the cutting edge. A friend recently recommended Topaz to me, but that isn't open source.
- NayamAmarshe 3y agoThe quality is actually comparable in some places. Upscayl being a free project though, does not have its own model yet and as such, we depend on community models (which are great in their own right). I do have plans to create our own robust model though, once I collect enough money :) https://ckovalev.com/midjourney-ai/guide/upscaling-ai-art-for-printing https://ckovalev.com/midjourney-ai/guide/upscaling-ai-art-fo...
- __rito__ 3y agoWhat models do you use to upscale images other than RealESRGAN?
- NayamAmarshe 3y agoWe have a custom-models repository with several models. Upscayl by default ships with 6 models.
- kristopolous 3y agoextras tab in a1111 is really the best results I can get. You need to know what all those options mean of course - it's a more complicated interface for sure
- EVa5I7bHFq9mnYK 3y agoxz utils is open source, so whats your point?
- mrbluecoat 3y agoI used to laugh so hard at those tv and movie scenes when they would "enhance" an image: https://youtu.be/LhF_56SxrGk https://youtu.be/LhF_56SxrGk I guess yesterday's science fiction is now our reality.
- palad1n 3y agoI think I've got a twitch now, when I think about this. How those stupid moviemakers would say, "enhance!" and I (along with many of my geek brethren) were like, "there are no more pixels, that can't be done!" And now it exists. "Enhance" exists.
- kyriakos 3y agoOr does it? If you enhance security footage to make a barely visible face recognizable it will make it but it won't be the person in the footage anymore.
- wood_spirit 3y agoIt would be really interesting to see what it upscales poor security footage to be when we know the people in the picture; how accurate was it?
- wruza 3y agoThe models usually bundled with ESRGAN don't enhance like CSI. They straighten lines and jpeg blocking a little and correct "subatomic" details, but cannot restore large areas like faces, objects, etc. It's more of an AI-flavored "Effects - Sharpen" than stereotypical "Enhance!".
- 112233 3y agoYou probably remember this: https://petapixel.com/2020/08/17/gigapixel-ai-accidentally-added-ryan-goslings-face-to-this-photo/ https://petapixel.com/2020/08/17/gigapixel-ai-accidentally-a...
- 3y ago
- sgilani 3y agoIs there something similar for video? Or is topaz still the only option?
- NayamAmarshe 3y agoI still have video upscaling planned for Upscayl but we're just 2 people, working on Upscayl in our free time.
- yterdy 3y agoVideo2x/Waifu2x GUI. Unfortunately, the models they ship with are tuned towards anime.
- feverzsj 3y agoThe upscaled image feels sharper but loses some detail.
- NayamAmarshe 3y agoEvery model will give you different results. You can try the custom models as well to see what works for you :)
- jiveturkey 3y agoThis should have been called Enhanse (sticking with the misspelling theme)
- _fw 3y agoUpScayl is great, I use it a lot for work. Upscaling low-res graphics and illustrations for use in graphics in a pinch, upscaling portrait photos of people for print and photoshop… upscaling old copies of things for editing purposes, you name it. It’s not perfect but no alternative is. Bloody useful though.
- NayamAmarshe 3y agoI'm glad you like it! We're working on making it even better :D and with the introduction of Upscayl Cloud the possibilities for professionals will be endless (within reason of course, haha)!
- _fw 3y agoLike it? My brother I was trying to hide my enthusiasm to look cool in front of people on YC. I use UpScayl pretty much every day and doing so feels like magic every time. Your user interface tweaks here and there are always appreciated and UpScayl is a joy to use. Feel proud, UpScayl is witchcraft and I love it
- NayamAmarshe 3y agoHaha thank you so much! Always a joy to see a happy user! Mind if I showcase your comment on the Upscayl website? :D
- _fw 3y agoYeah boiii. I’ll email you a proper quote tomorrow if that works?
- NayamAmarshe 3y agoYessir!
- vouaobrasil 3y agoI wonder if image upscaling is actually reflective of a greater disease in society: we are exceptionally obsessed with holding onto everything. I mean, my God, if the situation comes down to a desire to upscale an image, just let the image go.
- drusepth 3y agoThere are lots of reasons someone might want to upscale something, not just "holding onto everything". I painted something on my iPad over the last few weeks. I'll be upscaling it so it's high enough resolution to do a large print on my wall. It's not something I need to "just let the image go" for. (And, of course, there's nothing wrong with holding onto things...)
- pvankessel 3y agoAre there any models out there for cleaning up an image, not just upscaling? I have a bunch of old photos taken on early low-res point-and-shoots that have JPEG artifacts etc and this seems like something a modern model could easily be fine-tuned to resolve, but every few months I look around and have yet to find anything
- iampims 3y agoCheck out these models: https://replicate.com/collections/image-restoration https://replicate.com/collections/image-restoration Most of them can be run locally, but I’d recommend testing them with replicate before investing in understanding cog/docker/hf…
- pvankessel 3y agoOh this sounds like exactly like what I've been looking for, can't wait to give these a try - many thanks
- yterdy 3y agoUnfortunately, for video, nothing I've seen yet has matched the quality of Topaz Labs' (paid) tool. Clarity and consistency always seem to be an issue with other implementations. If love to be proven wrong because I have a project that's stalled due to the low quality/resolution of the source.
- aktuel 3y agoI still find current upscalers surprisingly underwhelming compared to advances in other areas.
- ewuhic 3y agoOn a related note, what would be the equivalent app for watermark removal?
- p0w3n3d 3y agoAnother upscaler, for images and video https://github.com/k4yt3x/video2x https://github.com/k4yt3x/video2x
- aitchnyu 3y agoIs there an upscaler which looks at other similar photos we took? Been looking for The Magic Photo App, reverses motion blur, can interpolate multiple photos to unblink some eyes and select best photos of a scene.
- deleted 3y ago[deleted]