5 ms·
Lytro Announces New Light-Field Camera Photo Features
- maak 14y agoThe interesting thing about Lytro is not so much it's current offering, but the potential the technology unlocks.
- erikpukinskis 14y agoI would be more excited about a Lytro that would record a second or so of full high speed video (1000fps would be ideal, but it'd probably still be useful with much less), so that you could adjust both the focus and the exposure after the fact. Eliminating the need to take a bunch of photos in a row to get a "good one" would be a legit improvement. That and fitting it into a phone. :)
- alanctgardner2 14y agoI would be interested in knowing if their tech could ever be phone-sized. It looks like focusing the light correctly on the sensor is more difficult than with a conventional camera ( their promo video looks to show about 8 lens elements). The entire design is basically a big lens with the sensor and screen on the back, that's why they adopted such a strange form factor. That said, there is significant variability in size with traditional camera lenses, so maybe once the market matures someone will figure out a way to produce cheap plastic light-field lenses. As far as the high-fps goes, they use a standard sensor with custom microlenses. Procuring a new sensor, either for higher resolution or faster frame rates, is probably more expensive and less likely than continued software updates, and maybe even changes to the enclosure and lenses. I suspect sensor acquisition is a significant part of these cameras high price.
- notlisted 14y agoSo it's a TWO-trick pony. I was going to order one. Severely underwhelmed after seeing the first images. The flash player requirement to view the multifocal pictures makes them next to useless (can't share on social networks, can't view on iPad, etc.). The focus shift feature is nice, but after seeing 50, it seems nothing more than a gimmick, and one that gets darn boring darn fast. This latest feature is cute as well, perhaps more useful even, but again not earth-shattering. It's just a matter of time before a Samsung simulates the same thing via 'focus bracketing' and storing lots of smaller pictures (they'd probably still be bigger than the Lytro "resolution"), apply a little "focus stacking" algorithm like Photoshop to determine "focal plane" hotspots, and load the focal plane based on the selected hotspot. This little video shows a "fake lytro" image created by taking 10 DSLR pix: http://www.youtube.com/watch?v=KozKofC01_Q http://www.youtube.com/watch?v=KozKofC01_Q This latest feature could possibly be "simulated" (equalled?) by slight physical movement (circular/conical?) of the sensor in the focal plane. The light field technology is rather ancient by Internet standards, e.g. see this lovely video on the Stanford Light camera, from 2006 (!) which also explains both features rather well: http://www.youtube.com/watch?NR=1&v=9H7yx31yslM http://www.youtube.com/watch?NR=1&v=9H7yx31yslM Finally, if you're still interested in experimenting with this, check out a $10 solution: http://web.media.mit.edu/~raskar//Mask/ http://web.media.mit.edu/~raskar//Mask/ So, where does this leave Lytro?
- cayal 14y agoI think Lytro lost some of the magic for me when I realized it was just utilizing a depth map to generate an iris blur. Looks like the same deal for the 3d effect, around edges you can see reconstruction artifacts. I'm impressed by the fact one lens can capture depth, but with two lenses at a narrow aperture they could create the same effect in higher resolution and quality.
- MBCook 14y agoMy understanding is that the camera's file format is essentially a stack of JPEGs and a depth map. That's how the camera can do it's own refocusing without needing a huge processor. It's not generating the image from the light field, it's combining regions of a series of JPEG images. I was really disappointed when I found that out. I thought the software on the computer was to process the raw data, but I guess not. I still might be interested, but the the form factor is odd. Worse is that since they decided to go with that shape, they had to make the screen very very tiny. It's an interesting product, considering it's the first of it's kind on the consumer market. I hope there is a version 2, because I think it could be very interesting. If it could shoot video, that could be pretty fascinating. Heck, tell other people how to use the format. A series of focal planes and a depth map? Seems like hackers might be able to come up with some pretty fun stuff.
- nrp 14y agoThis is actually not the case. I wrote a tool to pull apart the file format: https://github.com/nrpatel/lfptools https://github.com/nrpatel/lfptools The image is stored as a raw Bayer array on the camera. The conversion to stacked JPEG occurs on the computer. The camera has a pretty beefy DSP on board to do live refocusing on the preview.
- jgeorge 14y agoThe camera's raw format is indeed an entire light field (I've used nrp's tools, they're great). The camera import software creates a layered JPEG out of the raw data for uploading and sharing, since the size and the amount of math involved in refocusing the raw image on the fly is significant.
- tgb 14y agoAs someone who works with robotics, I can imagine the applications of a real-time, video version of this. Stereovision would become much simpler and more reliable.
- andrewcooke 14y agopeople don't have to invent bullshit explanations of how they think this stuff works - the thesis is here http://www.lytro.com/renng-thesis.pdf http://www.lytro.com/renng-thesis.pdf it is more than a stack of images.
- notlisted 14y agoIf you were referring to my post. I wasn't explaining how this works (I know how it works). I was outlining how I think the current effects/benefits to the consumer can be mimicked. The current output format, which is a stack of JPEGs with a depth map, would cover 80% of the result with 20% of the effort/technology. Capturing this stack of JPEGs (e.g. as high speed video frames) is not beyond the realm of our current camera technology.