10 ms·
Upscayl – Free and Open Source AI Image Upscaler for Linux, macOS and Windows
- liuliu 4y agoNCNN does work with just CPU. Just need a little bit more packaging.
- behnamoh 4y agoWould it be too difficult to add video upscaling feature to this? It'd really help with old videos. I have videos I took on my Sony Ericsson w810i in the 2000s. The joy of being able to capture something animated on a small screen... I remember it used to show what song is playing at the top and I thought "cool, it shows banners similar to what we see at the bottom of news channels"! Would be great to elevate those videos to today's standards.
- lijogdfljk 4y agore: Videos, that's the first item on the roadmap on the linked page
- social_quotient 4y agoIt’s not what you asked for exactly but I’ve had good success with this product https://www.topazlabs.com/video-enhance-ai https://www.topazlabs.com/video-enhance-ai Sometimes it drops the audio channel but it’s not too bad getting it added back in.
- Kukumber 4y ago
- MitPitt 4y agoIt's obviously the trained model that's heavy. It can't possibly be even close to 1mb.
- Kukumber 4y agoIt's the electron envelop
- NayamAmarshe 4y agoThe binaries themselves result in 10-25 megabytes. Along with that we ship multiple models currently. I'm not sure if around 300mb would be considered 'bloat' for an AI Image Upscaler. People who have low end hardware unfortunately cannot use the application anyway.
- simonw 4y agoJust had a look in the installed app on macOS: % du -h /Applications/Upscayl.app/Contents/Resources/models 76M /Applications/Upscayl.app/Contents/Resources/models 76MB of models / % ls -lah /Applications/Upscayl.app/Contents/Resources/models total 155920 drwxr-xr-x@ 14 simon admin 448B Aug 27 04:44 . drwxr-xr-x@ 62 simon admin 1.9K Aug 27 04:44 .. -rw-r--r--@ 1 simon admin 32M Aug 27 04:44 df2k.bin -rw-r--r--@ 1 simon admin 113K Aug 27 04:44 df2k.param -rw-r--r--@ 1 simon admin 1.2M Aug 27 04:44 realesr-animevideov3-x2.bin -rw-r--r--@ 1 simon admin 3.1K Aug 27 04:44 realesr-animevideov3-x2.param -rw-r--r--@ 1 simon admin 1.2M Aug 27 04:44 realesr-animevideov3-x3.bin -rw-r--r--@ 1 simon admin 3.1K Aug 27 04:44 realesr-animevideov3-x3.param -rw-r--r--@ 1 simon admin 1.2M Aug 27 04:44 realesr-animevideov3-x4.bin -rw-r--r--@ 1 simon admin 3.0K Aug 27 04:44 realesr-animevideov3-x4.param -rw-r--r--@ 1 simon admin 8.5M Aug 27 04:44 realesrgan-x4plus-anime.bin -rw-r--r--@ 1 simon admin 30K Aug 27 04:44 realesrgan-x4plus-anime.param -rw-r--r--@ 1 simon admin 32M Aug 27 04:44 realesrgan-x4plus.bin -rw-r--r--@ 1 simon admin 113K Aug 27 04:44 realesrgan-x4plus.param
- aaaaaaaaaaab 4y ago
- rixrax 4y agoAnother interesting feature might be image sharpener while maintaining the resolution?
- willnonya 4y agoZoom and enchance!
- wiz21c 4y agoBlade Runner stuff !
- NayamAmarshe 4y agoThat is planned :)
- willnonya 4y ago"Make the whole world use FOSS" At least they have realistic goals...
- LaputanMachine 4y agoThe app contacts Github's CDN every 45 seconds. Is there a particular reason / need for this behavior? Tested on macOS with the following command: sudo tcpdump -k -i en0 | grep Upscayl
- samstave 4y agoJust an aside as we all get Old Fat and Ugly, its actually a good thing to have such a simple reminder to grep for shit out of your egress just so you stay close to whats happening on the wire. I haven't thought about TCPDUMP in a long time, and I appreciate this man page.
- NayamAmarshe 4y agoIt must be because of the auto-update checker. It's a useful feature that lets us notify users about new versions and also let them download and install without opening the Github repository.
- gonzus 4y agoBut you check for updates every 45 seconds? Why?
- NayamAmarshe 4y agoIt's the electron-builder that's doing it, must be its default configuration. I'll see if I can fix the continuous checks and limit it to only at launch.
- LaputanMachine 4y agoThanks for taking a look at this! Maybe the update check is not completing in time and hitting a 45 second timeout similar to [1]? [1]: https://github.com/electron-userland/electron-builder/issues/4744#issue-576936436 https://github.com/electron-userland/electron-builder/issues...
- rahimnathwani 4y agoWhy not use Real-ESRGAN directly? https://github.com/xinntao/Real-ESRGAN https://github.com/xinntao/Real-ESRGAN
- creativenolo 4y agoVisual feedback. Visual interface. The GUI fad is still around.
- rahimnathwani 4y agoRight, but if a GUI is the only requirement, it might be simpler to use gradio. It only takes a few lines (pasted from https://huggingface.co/spaces/akhaliq/Real-ESRGAN https://huggingface.co/spaces/akhaliq/Real-ESRGAN): gr.Interface( inference, [gr.inputs.Image(type="pil", label="Input"),gr.inputs.Radio(["base","anime"], type="value", default="base", label="model type")], gr.outputs.Image(type="file", label="Output"), title=title, description=description, article=article, examples=[ ['bear.jpg','base'], ['anime.png','anime'] ]).launch()
- GrayShade 4y agoI actually tried, couldn't do it. Some version of numpy in their requirements.txt doesn't build with the Python on the my system. Sure, I could probably install another Python with conda, but it's not my idea of fun. The app here actually worked fine from the first try, without taking gigabytes of disk space.
- rysertio 4y agoWell you can use the ncnn version that is the backend for this program. https://github.com/xinntao/Real-ESRGAN-ncnn-vulkan https://github.com/xinntao/Real-ESRGAN-ncnn-vulkan
- rahimnathwani 4y agoOK. That makes some sense. I tend to assume everyone with a CUDA-capable GPU is already using conda. But of course that's not true.
- a1371 4y agoWhy all the negativity in the comments here? Yes, sometimes it is extremely valuable to make a nice thin wrapper on existing tech. As a community, we can't always complain about the user interface of FOSS tools, and then when someone makes a UI, again complain that they haven't done anything or the size is large. Pick a side!
- rvz 4y agoIt's Electron. That is why.
- tfsh 4y agoMaybe ask yourself why people chose to use Electron. The cross platform alternatives (Tauri[1] pops to mind) generally offer a more complex development experience. As long as web languages remain the lowest entrypoint they will remain the dominent force, even if they're less performant. 1: https://github.com/tauri-apps/tauri https://github.com/tauri-apps/tauri
- NayamAmarshe 4y agoYou're absolutely right. I tried building Upscayl with Tauri initially, but after a few days I had to give up because I was trading my time for bundle size. Then I tried Neutralino only to discover that it does not support node runtime. With Electron, we were able to focus on the core features and ship Upscayl very fast. Since electron is also the only framework that supports node modules, it was pretty much the best low-resistance path for us at the moment. I do wanna learn Rust eventually but that is an adventure for another day :)
- beefjerkins 4y agoAs someone venturing in Tauri as primarily a web dev, I can relate to this so much. Rust is great and Tauri has some stellar benefits, but until you really master the borrow mechanics, it slows you down so much.
- 4y ago
- Dwedit 4y agoIt's just relabeled Real-ESRGAN. Real-ESRGAN is still a very good solution, but I don't know if this project is contributing anything new.
- solarkraft 4y agoIt sure does for me. The other projects linked here are I find overwhelming, Upscayl I find approachable. The alternative I see to Upscayl would be some online service that's similarly approachable for "I just want to upscale this right now".
- NayamAmarshe 4y agoWe're making sure Real-ESRGAN reaches people who cannot use CLIs (so that pretty much includes 99% of the population). Also, I have a PR in the making for their ncnn-conversion script, it ain't much but it's honestly the best I can contribute when it comes to Python and AI. Real-ESRGAN creator also encourages others to use their tech in their projects, as mentioned in their readme. I know we're not really enhancing Real-ESRGAN's code at the moment, but we don't want to disrespect or disregard their hardwork either.
- knaik94 4y agoThis UI wrapper doesn't have any way to set options for upsample or tile size parameters. I also don't see any way for it to set the model yourself. https://github.com/xinntao/Real-ESRGAN https://github.com/xinntao/Real-ESRGAN The Real-ESRGAN page has links to additional uis to try out.
- NayamAmarshe 4y agoScaling is broken on Real-ESRGAN. That's why I had to remove the option for 2x and 3x and tiling can sometimes yield totally unexpected results. These 2 are the primary reasons why Upscayl doesn't show them.
- simonw 4y agoNice to see one of these that can use the GPU on my Mac laptop out of the box - I just tried it after installing from the .dmg, it worked great.
- NayamAmarshe 4y agoIt's honestly a relief. I do not have MacOS so I had to compile the software with a MacOS VM without hardware passthrough, it took me a whole day to set that up. I wasn't able to test it on the VM (because of lacking hardware acceleration) but some nice people from the community helped us test it and find bugs and issues for the Mac builds :)
- jacooper 4y agoDon't GitHub Actions offer MacOS builds?
- NayamAmarshe 4y agoThey do? Wow, I didn't know. I'll try setting up a workflow.
- simonw 4y agoI have an Electron app on GitHub which uses their macOS runners to run tests and even package and sign the application: https://github.com/simonw/datasette-app/blob/84903f2ab171fb2b584048fd068c951acc25f859/.github/workflows/test.yml https://github.com/simonw/datasette-app/blob/84903f2ab171fb2... Wrote up a bit about how that works here: - https://til.simonwillison.net/electron/sign-notarize-electron-macos https://til.simonwillison.net/electron/sign-notarize-electro... - https://til.simonwillison.net/electron/testing-electron-playwright https://til.simonwillison.net/electron/testing-electron-play...
- IceWreck 4y agoHow does Real-ESRGAN used here compare to waifu2x ? I've had great success using waifu2x, especially for blurry artwork.
- Tajnymag 4y agoESRGAN works better for photos in my testing.
- stavros 4y agoI tried Real-ESRGAN but it seems to dream up slightly too much? Has anyone else had this problem? It tends to generate details where there shouldn't be any. Maybe I need to add some setting?
- physPop 4y agoThis is commonly called 'hallucination' and is a confound in super resolution. Its particularly concerning when people throw SISR at medical imaging ...
- akerr 4y agoWas Upscail taken?
- can16358p 4y agoAnyone compared it against Topaz Labs' Sharpen AI/Gigapixel AI? Which is better (putting paid vs open-source debate aside) in terms of result image quality?
- can16358p 4y agoUpdate: tried it, and it failed miserably. I really wanted an open source project to be on par with a commercial/paid software but realistically speaking, the difference is day and night and Topaz wins hands down in my cases.
- Sugimot0 4y agoI like video2x[1] for this, a nice simple CLI with lots of different options for different cases, (especially the anime upscalers) used it quite a bit, also played with realcugan-ncnn-vulkan[2] which has given me pretty great results. [1]: https://github.com/k4yt3x/video2x https://github.com/k4yt3x/video2x [2]: https://github.com/nihui/realcugan-ncnn-vulkan https://github.com/nihui/realcugan-ncnn-vulkan
- aantix 4y agoVideo2x - is it only for cartoon/anime video?
- WrtCdEvrydy 4y agoThis is awesome... I wonder if we'll get something for video upscaling like this?
- eating555 4y agoThanks for the great tool! Although i know how to use those models, this makes my life more easier!!!!
- Cipater 4y agoIt really does need a GPU. Tried it on a laptop with integrated graphics and it crashed completely. Didn't even give a BSOD, machine just went dead and rebooted.
- ldng 4y agoCould something similar applied to 3D scanner points cloud ? Would Real-ESRGAN work in 3D ?