4 ms·
Sarcasm aside, this is mostly about their custom ML denoiser for the video: >Using an onboard 5nm AI chip, the Ace and Ace Pro cameras use a custom-trained AI
by orbital-decay 3y ago
Sarcasm aside, this is mostly about their custom ML denoiser for the video:
>Using an onboard 5nm AI chip, the Ace and Ace Pro cameras use a custom-trained AI neural network to denoise the footage for a clearer image in real time, Insta360 claims.
ML denoisers are pretty useful in high-quality photography if done right. Photographers were initially skeptical at large, but quickly accepted it, as products from Topaz, DxO, and alike were giving excellent results. You are extremely unlikely to stumble upon any invented detail in a denoiser like this.
- foldr 3y agoAlso, any denoiser is 'inventing' details. You can't know for sure what the value of the pixel would have been absent noise. It's always a probabilistic guess. Guessing based on higher level details just produces different kinds of artifact (and possibly more noticeable ones in some cases).
- hyperbovine 3y agoThis quibble is just going to completely cease being a thing in 5-10 years.
- deleted 3y ago[deleted]
- foldr 3y agoHmm, maybe it sounded like I was saying that ‘inventing’ details is a bad thing. The point I was trying to make was the opposite. Any attempt to remove noise will involve ‘inventing’ pixel values based on probabilistic information, and it doesn’t really matter that much (to me) if that information is derived from the values of a few neighboring pixels or from a higher-level model of the scene.
- bastawhiz 3y agoWhen I ride my motorcycle with my insta360, the difference between one gray pixel and a slightly different gray pixel for the asphalt is really not something I care about. What I care about is that I can't notice it. If the denoising model does a better job of making up convincing pixels, that's a win. The outcome I'm looking for is a video with fewer visible artifacts caused by the limitations of the hardware.
- foldr 3y agoI agree. Possibly it somehow sounded like I was saying the opposite, but I was just expanding on the point made by the post I was replying to.
- lambdasquirrel 3y agoI have to quibble on this one for technical correctness. These denoisers remove detail, not add them. The assumption is that you should have flat and even areas, not finely pixelated areas.
- Toutouxc 3y agoDxO DeepPRIME XD (their newest and greatest AI denoiser) seems to actually invent details. If I take a picture with my mirrorless of a bookshelf from across the room at ISO 32000 and let XD go crazy at it (slider to the right), it reconstructs gibberish letters on the book covers. If I don’t let it go crazy and keep it subtle, the results are incredible. Tbh for my camera (EOS R10) and DxO, low dynamic range, not noise, is now the limiting factor for high ISO photos.