3 ms·
Public raw image datasets are rare, probably because most cameras, except DSLRs, don't support storing raw images. Also, the nature of the inference may not re
by lovelearning 8y ago
Public raw image datasets are rare, probably because most cameras, except DSLRs, don't support storing raw images.
Also, the nature of the inference may not require high fidelity raw images since they're going to be down-sampled anyway. Unless research suggests that raw images improve inference metrics, nobody's going to invest effort into building a raw image dataset. One notable recent exception to this is the "Learning to see in the dark" paper on low light image enhancement[1] - they found that training on raw images gives much better enhancement than JPEG.
The data availability problem may start getting solved in the near future because mobiles (atleast Android) support storing and processing raw images, and on-device learning and inference capabilities are getting better all the time on mobiles.
[1]: https://www.youtube.com/watch?v=qWKUFK7MWvg&feature=youtu.be https://www.youtube.com/watch?v=qWKUFK7MWvg&feature=youtu.be
- dosshell 8y agoInteresting link! Yhea, I guess JPEG destroys a lot information low light images. > probably because most cameras, except DSLRs, don't support storing raw images This may be true for consumer cameras but not for machine vision cameras. Most color machine vision cameras do support the Bayer format. Basler, FLIR (Point Grey), IDS and so on all support the Bayer format. If you roll your own camera you definitely have to deal with the Bayer format from the sensor you are using. And if you do not want any compression on your data-set images the Bayer format also takes less space than the RGB format. I'm not arguing it is a good idea, I'm just interested if it works :)
- lovelearning 8y agoIt's useful information about industrial machine vision cams, since I don't have any experience with them. You are right about custom cameras - in fact, I have some camera modules for experimenting with surveillance, night vision and machine learning, and some of their datasheets mention registers that, when set, output Bayer format images. Machine learning in surveillance is still a rather under-serviced market, but it's potentially a rich source of raw image datasets. Raw format training and inference definitely work. The obstacle is only data availability.
- taeric 8y agoJPEG definitely destroys low light information. I've had some pictures I took with in RAW that I thought had nothing in them, clicked "optimize" in generic photo editor and realized I could make out a ton of detail. Didn't magically recover a good photo, mind, but was a lot more information than originally visible. Tried from the JPEG and got nothing.
- fulafel 8y agoPhones have recently started to support raw photos - both iOS & Android.
- lovelearning 8y agoThanks! Useful to know it's supported on iOS. I have never worked with iOS and hence mentioned only Android.