10 ms·
Looking Glass – A new type of holographic interface
- cryptonector 8y agoThe kickstarter page for it: https://www.kickstarter.com/projects/lookingglass/the-looking-glass-a-holographic-display-for-3d-cre https://www.kickstarter.com/projects/lookingglass/the-lookin...
- fhood 8y agoMy first inclination was to dismiss it as a gimmick, and really it is a gimmick, but it is so damn cool that I want one, especially if the Api's are relatively good.
- lbm 8y agoEven if it's a bit of a gimmick in its current state, it's a great step towards something truly useful. Technology like this could be amazing in fields like medicine and education.
- CarbonJ 8y agoI've played around with some of Looking Glass's earlier prototypes and was impressed with the effect. It's one of those technologies like VR - very different in-person than seeing it in a video.
- _bxg1 8y agoPretty cool, and probably will be useful in certain industries, but the title is extremely clickbait-y. The movie holograms that are listed don't live inside a glass box.
- hateful 8y ago"The Looking Glass generates 45 distinct views of a three-dimensional scene" Now that GPUs can reliably generate 60 FPS, this is the next step to push that technology. Because you'll need 45x60FPS for the same quality. And then you'll push the 45 number higher. (yes, I know the 60 isn't visible and has to do with control input).
- pasta 8y agoI'm not sure I get your comment. In my mind you can render $x pixels at 60fps. So the number of pixels for each distinct view is: $x / 45.
- hughes 8y agoI think it's a little more complex than that. In addition to rasterizing a large number of pixels, the entire vertex pipeline has to run 45 times to generate 45 projections of the scene's geometry. You're correct though in that the rest of what happens in a frame (physics, animations & other state updates) do not have to run 45x.
- gmueckl 8y agoThis is an application where ray tracing for primary rays should shine. Instead of having to project thw scene 45 times you only need 45 sets of ray bundles, which is really efficient. The acceleration stuctures are shared between views. With a few pixel reordering hacks you can essentially generate all viewpoints as a single high resolution frame.
- pasta 8y agoThis is exactly what I was thinking about. With raytracing you will almost get this for free.
- digikata 8y agoFor one, prerendered 3D video could go as detailed as the transfer pipe & display would allow. For another, the worst case cost is $x/45, but I would think that might improve as 3D programmers figure out optimizations in terms of multi angle view rendering.
- westoncb 8y agoYou're right. This is essentially meaningless: "Now that GPUs can reliably generate 60 FPS ...." That depends entirely on what you're rendering. You could reliably hit over 60 FPS for decades—for some content. And now you can still render at .000000001 FPS for other content. Saying "GPUs can generate 60 FPS" is presenting the situation as if framerate were a function of hardware only, whereas the reality of the situation is that it depends at least as much on the software.
- xori 8y agoI wonder if it's a 4k screen generating 45 different views in alternating locations on the screen. Thus your new resolution is like 720x256. From the videos they look higher res than that.
- nv-vn 8y agoIt's like 2560x1600 interlaced
- xori 8y agoThat leaves even less resolution, in what orientation are they using the lenticular lens then? It must be less than 45 unique views and they smear between them.
- bufferoverflow 8y agoIt's a lightfield display, not a lenticular display. Lightfield lens bumps go in two spacial directions: http://graphics.stanford.edu/projects/lightfield/leslie-holding-bumpy-sheet.jpg http://graphics.stanford.edu/projects/lightfield/leslie-hold... http://real-eyes.eu/wp-content/uploads/2015/05/Technologie_01.jpg http://real-eyes.eu/wp-content/uploads/2015/05/Technologie_0... I guess in their case the microlenses aren't even round, since 45 is 5*9. I guess they have 9 horizontal X 5 vertical pixels per microlens.
- xori 8y agoIf you were smart you could encode multiple views into a single pixel to get a higher resolution, but then I figure that would limit your colour depth availability.
- hughes 8y agoHow would encoding multiple view into a single pixel work with a lenticular display? There needs to be a physical distance between each of the views.
- JeffreyKaine 8y agoI really want this in an arcade cabinet for a streetfighter-esque game, or side scroller!
- mbroncano 8y agoI couldn’t stop thinking of [0] after reading your comment [0] https://en.wikipedia.org/wiki/Time_Traveler_(video_game) https://en.wikipedia.org/wiki/Time_Traveler_(video_game)
- rmason 8y agoI've wanted to watch a Broadway play in my living room that was indistinguishable from being in the theater for close to thirty years. I'm excited because this is the closest technology that I've seen that could make this possible. But I'm saddened if this is really the Apple II version of this technology because if it takes another forty years I probably won't live to see it. Always imagined that there would be sensors on the floor and ceiling, not watching it in a glass box but if that's how it has to be I'm OK with it.
- angel_j 8y agoIn 40 years since Apple II, technology has doubled roughly 26 Moore's, or moresies. The same shift now-a-days should take only a year and half (40 / 26), which is about how long it would take if you bought 64 Looking Glasses and built a DIY array, and used ML to construct a 3D video from a 2D one, a la https://en.wikipedia.org/wiki/3D_reconstruction_from_multiple_images https://en.wikipedia.org/wiki/3D_reconstruction_from_multipl...
- janoc 8y agoThese lenticular autostereoscopic displays have been around for a long time and never quite took off. There have been even 3D TVs (Philips) using this idea. I am not quite sure what is "new" apart of yet again abusing the "holographic" term (hint, it has zero to do with holograms or holography). The major issues with these are the limited viewing angles and the enormous bandwidth needed to both render the individual points of view and to actually transfer them to the screen. Heck, a lot of computer games have problems to generate stereoscopic (i.e. 2 images) content at 60 or 90fps required by the VR helmets such as Rift or Vive these days. And these guys want to push 45 distinct images at 60fps? Good luck with that, especially for that ridiculous price for a tiny screen. These guys offer a 4k, 50" screen: http://www.ultra-d.com/ http://www.ultra-d.com/
- maxton 8y agoThis isn't quite the same as what you're talking about. The lenticular displays only vary in the x-dimension, but this display seems to work in both dimensions, which would probably create a noticeably better 3D effect.
- colanderman 8y agoDoes it? The demo videos only move the camera side-to-side. I can't find anything detailing whether the image is holographic in the Y dimension.
- modzu 8y agolooking glass is also x-dimension only: https://www.kickstarter.com/projects/lookingglass/the-looking-glass-a-holographic-display-for-3d-cre/comments?cursor=21131425#comment-21131424 https://www.kickstarter.com/projects/lookingglass/the-lookin...
- mozumder 8y agoYes the problem with light-field displays (and cameras) is that they do need massive bandwidths. But there are ways to mitigate it somewhat. It's possible to have a gaussian or random distribution of light rays so that you end up with only average about 10 or so rays per pixel, instead of the 45 here. But yes, expect to need a massive increase in bandwidth for light-field holographic displays. This includes headset VR mounts, where you can finally have a display without the limited field-of-vision that you'd have from current VR headsets. A VR headset can focus the light rays towards the range of each eye, which can also cut down on bandwidth.
- dbspin 8y agoSeems to be a direct successor to the 'HoloPlayer One' dev kit, shown off last year by the same team - https://www.youtube.com/watch?v=zJZj9Iy8Vck&feature=youtu.be https://www.youtube.com/watch?v=zJZj9Iy8Vck&feature=youtu.be
- doublerebel 8y agoI played with the large size version of Looking Glass at AR in Action conf this January at MIT. It's really cool, and the coolest part is the interaction is intuitive. You really can just touch a point on the hologram and have it react at that point. As others have mentioned, it requires pushing quite a number of simultaneous views of the hologram through a hidpi display, the experienced resolution is not very high as a result and the holograms look a bit fuzzy. It is right now probably the best out-of-the box way to interact with Holograms, especially in a shared environment. Hololens can't share holograms by default, and even if the app has implemented sharing, the holograms can't be touched. Meta glasses have some touchability thanks to their depth sensor, but again there's no easy shared way to interact with a hologram. I think AR like Looking Glass is underrated, they were very smart to use natural interaction instead of gestures or a mouse/wand. That being said, I don't see it competing with AR glasses longterm.
- colanderman 8y agoDo you remember if the image varies in the vertical plane as well as the horizontal? The demo videos only move the camera horizontally.
- powerapple 8y agoif it is stacked screens, I don't see any reason it will work horizontally only. I believe the view angle is still very limited. I'd love to use this for Skype chat or something.
- bawana 8y agoIf the lenticular lens is made of columns (as those fake 3D postcards are) then only horizontal shift is 3D-able. To display verticality, the lenticular lenses could be hemispheres. However, to encode vertical 3D-ness you would need 45 images for each 2 degrees off the horizontal so as your head bobs up and down, it can pick up the off axis images. So that's 45 images x 45 axes = 2025 images per frame.
- keksdev 8y ago
- xixixao 8y agoThis is only really valuable for multi-user scenarios. Just going with head tracking would likely be much easier to introduce, as you don't need specialized hardware (albeit it helps to improve quality). I remember this from a years and years old demo made on PlayStation I think, anyhow here are top results on this tech from Google: http://www.anxious-bored.com/blog/2018/2/25/theparallaxview-illusion-of-depth-by-3d-head-tracking-on-iphone-x http://www.anxious-bored.com/blog/2018/2/25/theparallaxview-... https://www.wired.com/2011/05/3-d-ipad-head-tracking-app-now-in-app-store/ https://www.wired.com/2011/05/3-d-ipad-head-tracking-app-now...
- nine_k 8y agoI can immediately imagine how several doctors could use such a display for e.g. a tomogram or stereo-microscope output during a surgery, or something like that. It could also make a good in-store display.
- gravypod 8y agoUnfortunate name collision with Wendle's (level1techs) and crew's Looking Glass for sharing a frame buffer with a vm
- digi_owl 8y agoLooking Glass is all over the tech field. https://en.wikipedia.org/wiki/Looking_Glass_Studios https://en.wikipedia.org/wiki/Looking_Glass_Studios
- rgovostes 8y agoIt was also the name of a 3D desktop environment from Sun showed off in 2003. https://en.wikipedia.org/wiki/Project_Looking_Glass https://en.wikipedia.org/wiki/Project_Looking_Glass
- itronitron 8y agothis is similar to what I imagined when I first read the initial press release for Magic Leap (years ago now) albeit on a smaller scale. This looks far more promising for the entertainment industry than vr/ar goggles. My only nit is that they didn't use the dancing baby (from ~1998/99) for the demo video
- enjrolas 8y agoall you had to do was ask https://youtu.be/V4vVUXNotI0 https://youtu.be/V4vVUXNotI0 <3
- itronitron 8y agothis is awesome :)
- rrdharan 8y agoThis sounds cool and all but it’s not worthy of the name until you can flip windows over and write on the back of them. https://en.wikipedia.org/wiki/Project_Looking_Glass https://en.wikipedia.org/wiki/Project_Looking_Glass
- est 8y agoReminds me of Zebra Imaging. Does anyone know what happened to it?
- jobigoud 8y agoFoVI3D.
- lerie82 8y agoIt doesn't look very impressive from any of the videos, just looks 3D to me.
- chmike 8y agoHolography is a very particular set of 3d image rendering technique. This volumetric display is not holographic. To me it's a frustration. Microsoft's highjacking of the word holography is also frustrating. Such abuse does not server the product and it's inventors. Truly holographic displays will emerge once we can control ligth interference in the display.
- dosy 8y ago> Truly holographic displays will emerge once we can control ligth interference in the display. Could you explain this a bit more please to give an idea of the path to get there?
- _ph_ 8y agoNot the poster above, but I will try a short explanation. You see an object, because light goes from its surface (either emitted or reflected ambient light) to your eyes. You see it in 3 dimensions, because the light differs by the viewing angle. Holography is a technology of recording the light "emitted" by the object. The light has to be recorded in direction and intensity. This is done via interference between the object light (waves) and a reference light wave, which usually is a planar wave of light. This interference creates an interference pattern, which can be recorded by film. The trick is, that if you develop the film to get the black and white pattern, you can shine the reference wave onto the film and it interacts with the interference pattern such that the object wave is reconstructed. A hologram such is an exact recording of the light emitted by the object. This is something the display tries to emulate by offering 64 different images, but not quite the same. As the interference pattern is just a greyscale image, one could use an ultra-high resolution lcd display to synthesize that - there have been demonstrators of that, but I am not aware of a large holographic display so far.
- dosy 8y agoThat's a great explanation, thanks. For the way you described it, to me, it doesn't sound that hard. - Create interference pattern - Record interference pattern - Shine ref light onto pattern to recover emitted light If done perfectly would this yield a convincing hologram (what I might try to describe as "visual sense impression of real 3D object being present" ) ? What are the major limitations in the current technology? You said it might be possible for high end screen, does that mean there is hologram tech out there? I have never seen any demonstrated. Is there some sort of information processing problem that software could solve on the interference pattern? Or is this more a physics problem -- maybe we do not have the materials that can do the steps required?
- Animats 8y agoIt's not a hologram, of course. It's a stack of flat displays. That's been tried before, in many ways. The first try was a vibrating mirror.[1] There's a flat rotating mirror system from FakeSpace.[2] It's not bad; you can walk around it. Move vertically, though, and the illusion breaks down. There's a scheme with gas ionized by intersecting laser beams. That's very low-rez, but truly volumetric. Eventually, someone may come up with a real hologram system with decent resolution. A research group at MIT built one, but it was very low resolution and single-color. It's not impossible. But this isn't it. [2] https://www.youtube.com/watch?v=8gvPS1m40gw https://www.youtube.com/watch?v=8gvPS1m40gw
- lhl 8y agoI'm pretty impressed by what FOVI3D [1] has been doing w/ their light field displays. Here's a recent interview from SID Display Week this year [2] that's refreshing because the CTO (in the interview) goes into some of the details of the challenges they face and isn't unrealistic about how hard it'll be to overcome them. [1] http://www.fovi3d.com/ http://www.fovi3d.com/ [2] https://www.youtube.com/watch?v=GK4544D4PUo https://www.youtube.com/watch?v=GK4544D4PUo
- jedimastert 8y agoDid you forget the first link?
- Luuseens 8y agoThere's also multi-planar rear-projection screens by Lightspace[1], they essentially have a stack of liquid crystal diffusers (20 or so) that can switch between transparent or diffusing state. [1]http://lightspace3d.com http://lightspace3d.com
- mosselman 8y ago"I think most people don’t want this 1984 vision of the future, where everyone is geared up 16 hours a day." I assume the author means the book '1984' by George Orwell and I come to the conclusion that the author has never read the book and does not know what it is about. Not every dystopian story is 1984. A far more logical reference would have been to 'Ready Player One' by Ernest Cline which is in fact about a dystopia in which people _are_ 'geared up' all the time. I recommend both books, the first is a work of genius and is, sadly, very relevant today and the second because it is very entertaining and might offer insights into the development of VR in the near future.
- beobab 8y agoLiterary warning: The first book shocked me to the core of my being, and I wept genuine tears of sorrow and grief; The second had me cheering the hero on. It's a great action book with loads of geekery and nerdness from my childhood. My recommendation: Read 1984 first, so you have good feelings to end on.
- aeorgnoieang 8y ago"1984" also just means 'dystopian'. It's not always a literal reference to that specific work.
- mung 8y agoI think it really only means 'dystopian' to people who have not read 1984. Otherwise there is a perfectly good word:'dystopian'.
- aeorgnoieang 8y ago'1984' is a particular type of dystopian; it has specific connotations, associations, etc.
- fezz 8y agoLooks like a lenticular display with some filtering and refraction to expand the perceived focal plane outwards. It also looks like it works best with a black background. https://blog.lookingglassfactory.com/introducing-the-looking-glass-a-new-interactive-holographic-display-8733cdaea40e https://blog.lookingglassfactory.com/introducing-the-looking...
- tobbebex 8y agoA couple of years ago I worked with the 3d engine for an autostereoscopic display at Setred (https://m.youtube.com/watch?v=zkwq_cQNLU8&feature=youtu.be https://m.youtube.com/watch?v=zkwq_cQNLU8&feature=youtu.be). For us the DVI bandwidth was the limiting factor to deliver 40-50 views at reasonable framerates (besides raw GPU computing power), so our display actually had 8(!) DVI inputs. That also gave us a natural interface to add distributed rendering, supporting up to 8 GPUs for rendering. In most cases though, one monster PC with 3 GPUs and 5 DVIs was enough to produce interactive framerates.
- lawlessone 8y agoThis would be great for voxatron.
- tinus_hn 8y agoSounds like a cool idea but if you use the first name that comes to mind you’re bound to not be the first one who thought of it. So there already are a ton of things called Looking Glass.