3 ms·
It's not in the cloud, this is all done on-device. They have a moon detection AI model that they pass the image through, the output of which is then used to set
by gincent 4y ago
It's not in the cloud, this is all done on-device. They have a moon detection AI model that they pass the image through, the output of which is then used to set up and then run the moon enhancement model, which fills in the detail from moon images it's been trained upon.
These are part of a larger package of super-resolution models and processing pipeline that Samsung licenses from ArcSoft, a computational photography software company that specialises in mobile devices.
- jaclaz 4y ago>... Samsung licenses from ArcSoft ... Interesting, though there seems to be no reference to this kind of function in Arcsoft site: https://www.arcsoft.com/product/single-camera-solutions-on-smartphone.html https://www.arcsoft.com/product/single-camera-solutions-on-s... https://www.arcsoft.com/product/dual-camera-solutions-on-smart-phone.html https://www.arcsoft.com/product/dual-camera-solutions-on-sma... What they mention seems more "logical" enhancements, though the selfie feature of gender and age detection : https://www.arcsoft.com/product/single-camera-solutions-on-smartphone/selfie.html https://www.arcsoft.com/product/single-camera-solutions-on-s... is somehow creepy. Anyway, if they can recognize gender and age and what do you have in your refrigerator ("This offers users a smoother and smarter refrigerator experience.") : https://www.arcsoft.com/product/smart-refrigerator-solutions.html https://www.arcsoft.com/product/smart-refrigerator-solutions... surely they can recognize the moon. Now that they made me think about it, my refrigerator experience, while usually smooth enough, is pretty dumb and repetitive.
- gincent 4y agoOn Samsung devices that support this, it's implemented in the file libsuperresolution_raw.arcsoft.so in /system/lib64, if you're curious to have a look at how it works. Some strings from that file, relating to the moon detection and enhancement process: AHDR_SetMoonMask ai_moon ArcSoft_Moon_Detection_2.1.125231001.2 ArcSoft_MoonEnhancement_1.1.12021.257 ARC_SRR_DisableDaytimeMoonScene ARC_SRR_GetMoonSceneType ARC_SRR_SetMoonWeight bMoonMode bMoonProtect MFSR Moon Detect moon count is %d MoonDetect MoonDetect_Init %s_%02d_AIE_Output_ISO_%d_DRC_%0.2f_HDRMoon_%d_%dx%d %s_%02d_CropMoonMask_Idx_%d_%dx%d %s_%02d_DaynightAIMoon_Output_Idx_%d_%dx%d %s_%02d_DaytimeAIMoon_Output_Idx_%d_%dx%d %s_%02d_MoonDetection_Input_%dx%d %s_%02d_MoonHDR_Output_ISO_%d_DRC_%0.2f_HDR_%d_Moon_%d_%dx%d %s_%02d_MoonMask_Idx_%d_%dx%d %s_%02d_ResizedMoonMask_Idx_%d_%dx%d /sdcard/download/arcsr/%s_moon_mask_%dx%d.gray %s/FusionRun_pMoonmask_%dx%d.gray void mfsr_moon_detect(gk_mfsr *)
- buildbot 4y agomoon count is %d I am extremely tickled that they planned ahead for multiple moons.
- buffington 4y agoI suspect that if the AI detects two moons, it probably abandons "enhancement" and drops a message in the logs (or renders an error, though I doubt that's what that particular string is for).
- jaclaz 4y agoNow that you provided a good reference keyword (Arcsoft), it seems that it all already happened for the Galaxy S21 a couple years ago: https://www.inverse.com/input/reviews/is-samsung-galaxy-s21-ultra-using-ai-to-fake-detailed-moon-photos-investigation-super-resolution-analysis https://www.inverse.com/input/reviews/is-samsung-galaxy-s21-...