14 ms·
1000fps image projection on deforming non-rigid surface
- deedubaya 7y agoThis is pretty neat.
- cheschire 7y agoThis seems like an extremely advanced version of those sand tables at science centers that kids play with, where digging a trench in sand with your hand modifies the projection to affect virtual water flow. The youtube video[0] from that page is especially interesting. 0: https://www.youtube.com/watch?v=-bh1MHuA5jU https://www.youtube.com/watch?v=-bh1MHuA5jU
- raihansaputra 7y agoYeah, and for the sandboxes, latency is the part that breaks the immersion. But it is straightforward to set up with a kinect and a projector.
- pvinis 7y agoThis is crazy awesome! And look at this one! I don't know if it comes from the same project, but looks cool. https://www.youtube.com/watch?v=c40cxE-dfPg https://www.youtube.com/watch?v=c40cxE-dfPg
- timdorr 7y agoYes, same research group: http://www.k2.t.u-tokyo.ac.jp/vision/MIDAS/index-e.html http://www.k2.t.u-tokyo.ac.jp/vision/MIDAS/index-e.html
- ohadron 7y agoThis is from 2016, but still very cool.
- qnsi 7y agothis makes me even happier. Means SOTA is even more advanced?
- kuu 7y agoSimple but effective. Really cool.
- mrlala 7y agoThat demo looked incredible!
- timdorr 7y agoThe second generation of the projection tech does color: http://www.k2.t.u-tokyo.ac.jp/vision/dynaflashv2/index-e.html http://www.k2.t.u-tokyo.ac.jp/vision/dynaflashv2/index-e.htm... And they can now do the tracking without the infrared paint: http://www.k2.t.u-tokyo.ac.jp/vision/MIDAS/index-e.html http://www.k2.t.u-tokyo.ac.jp/vision/MIDAS/index-e.html
- SiempreViernes 7y agoVery cool, a sort of live-action cgi capability. Hope it doesn't easily scale out to larger spaces and crowds, or the current tech industry would soon have public spaces filled with ads projected on peoples belongings.
- Frost1x 7y agoGoing to start ordering everything coated in vantablack then... https://en.m.wikipedia.org/wiki/Vantablack https://en.m.wikipedia.org/wiki/Vantablack
- ryanmcbride 7y agoUnless you're Anish Kapoor you'll have to settle for Black 3.0 https://www.culturehustleusa.com/products/black-3-0-the-worlds-blackest-black-acrylic-paint-150ml https://www.culturehustleusa.com/products/black-3-0-the-worl...
- panopticon 7y agoPlus, Black 3.0 isn't toxic like Vantablack.
- matt4077 7y ago...or Anish Kapoor.
- 7y ago
- phkahler 7y agoAnother use of a high speed projector would be to create real 3d display anywhere in a volume swept out by a moving surface. Objects will be translucent, but otherwise real 3d with wide viewing angles.
- jiofih 7y agoThat’s an amazing idea. A naive approach would be to slice the volume into N surfaces (say, ~30 layers to stay above 30fps) but there is probably a much more efficient organic pattern or interlacing that would give good volume and angle coverage at much higher resolution - think of crumpled cloth blowing in the wind at speed.
- jhallenworld 7y agoIt's been done- https://thefutureofthings.com/3029-the-return-of-the-3d-crystal-ball/ https://thefutureofthings.com/3029-the-return-of-the-3d-crys... https://www.youtube.com/watch?v=9U80TK6PAVc https://www.youtube.com/watch?v=9U80TK6PAVc
- phkahler 7y agoThe first I heard of it in the 1980s. TI used a laser to project point on a rotating surface. Then someone used a flexible mirror in front of a speaker. The mirror would flex convex/concave changing the apparent distance to a vector display screen. Just saying a modern 1000fps display could do this much better.
- leni536 7y agoThat flexing mirror idea is really smart.
- aasasd 7y agoAfaik that's one of the more popular current 3d display technologies: https://www.youtube.com/watch?v=FVYoWsxqK8g https://www.youtube.com/watch?v=FVYoWsxqK8g
- ericls 7y agowow
- qnsi 7y agoI think it would be very interesting idea for a music show. Tell everyone to dress using white tshirts and create this kind of projection from multiple beacons standing spread in the venue. Not sure if that would be possible but very cool to see IRL and talk about
- onion2k 7y agoMy initial reaction was that it would be brilliant to use in theatre productions.
- thepete2 7y agoThere he is! The guy in the red shirt! blue shirt! striped shirt!
- icebraining 7y agoThe idea of a stage version of A Scanner Darkly's scramble suit seems amazing.
- mattio 7y agoThis is awesome!
- cameron_b 7y agoThis is so cool. Now I want to take this ( and so many more things like it that have come up recently ) and show the students at the art school I attended that projection mapping can be so much more than lining up all the parallel lines.
- Nelkins 7y agoMy first thought is that this could provide some awesome effects for live theater.
- daenz 7y agoVery cool. I do live projection work[0] and latency is always the killer with immersion. Anything higher than a 1000/90ms latency breaks integration at normal dancer movement speeds. 1000fps seems like overkill but it allows for very fast movement. 0. https://youtu.be/ggRcDQZWD_8?t=1281 https://youtu.be/ggRcDQZWD_8?t=1281
- injidup 7y agoNice work :)
- goblin89 7y agoIs this real-time 3D taking into account dancer’s motions? I imagine it takes a crazy GPU rig? In any case, very impressive.
- daenz 7y agoIt is, but I cheat! The dancer has a small android device with a custom gyroscope app, mounted in the middle of her back. I can get her general orientation accurately this way (more accurately, and faster, than state of the art pose estimation). I am in the process of bringing together a community around art making like this. Let me know if this is something that interests you.
- goblin89 7y agoIt is of interest! I am in the process of learning TouchDesigner, looking to integrate it with Ableton Live. I doubt I’ll have enough GPU power for real-time 3D renders based on changing sound or visual input though… Currently I am considering pre-rendering scenes to given BPMs (where applicable) and doing only limited realtime alterations with TD nodes.
- jcims 7y agoReminds me of this high speed tracker video from 2013: https://www.youtube.com/watch?v=qn5YQVvW-hQ https://www.youtube.com/watch?v=qn5YQVvW-hQ Much easier problem to solve at 1k fps but still cool.
- Dunedan 7y agoReminds me of Jeff Han's original multi-touch demo. Slightly different topic, but also mind-boggling back then: https://www.youtube.com/watch?v=EiS-W9aeG0s https://www.youtube.com/watch?v=EiS-W9aeG0s
- bsenftner 7y agoIn 1899, H.G. Wells wrote "A Story of Things to Come", which later was adapted become the 1936 film "Things To Come". In the original story, the main characters mention being irritated by the advertisements projected onto the backs of the people they walk behind. Old idea, only now possible without image distortion.
- abledon 7y agoThere are going to be clubs/bars/venues that will market themselves as "foo" enabled light spaces for your "bar" apparel. we really don't need this stuff to overload our already maxed out sense organs but here we go!
- devicetray0 7y agoThe demo video answered my questions, is short and the tech is impressive. Not entirely sure of the business model though. The non-rigid tracking might be more useful than the projection -- perhaps a Defense application?
- saganus 7y agoI immediately thought of Disney parks and stuff like Cirque du Soleil and other performances (concerts, raves, etc)
- Frost1x 7y agoSkimming the description, they used a structured light approach (active) for geometry deformation tracking. This is still probably useful for certain defense applications but an ideal goal is often to use passive tracking systems. It's impressive either way. Lots of theater, performing, and visual art uses come to mind.
- fastball 7y agoStreamers could liven up their streams with this tech.
- mrandish 7y agoSome retailers (especially Japanese ones) have a fascination with the idea of allowing customers to "try on" different colors/styles via an on-screen avatar that's based on a scan of the customer. This would seem like a logical next step. I'm unsure how much customers would actually want it though, at least after the novelty wears off.
- janimo 7y agoSomething like this should play a role in the future of more sustainable clothing/fashion.
- newshorts 7y agoMilitary camouflage applications?
- fortran77 7y agoThey can project what's behind an object onto an object to make it "invisible"
- mayli 7y agoHow could you demo that?
- tqkxzugoaupvwqr 7y agoTurn the projection on and off to see the cloaking in action?
- slim 7y agoinvisibility cloak is not far away
- nemo44x 7y agoHow would you project it onto the person without giving away their position?
- jessaustin 7y agoInvisibility cloaks need to work from multiple points of view?
- deleted 7y ago[deleted]
- ChrisMarshallNY 7y agoThis is very cool. I suspect that it's only a matter of time before all projectors work like this.
- johnflan 7y agoAdvertisers will love this.
- draw_down 7y agoThis is the coolest thing I have seen in so long. Even if it's old, I don't care.
- gambler 7y agoYou want a high-bandwidth interface to computing? Combine this with Dynamicland technology (https://dynamicland.org/ https://dynamicland.org/). This makes way more sense than creepy neural interfaces. Best of all, it would allow people to freely collaborate on things in real life.
- airstrike 7y agoThis here is the real winner. The thread is full of amazing ideas but successfully executing this one combination would be a complete paradigm shift.
- elif 7y agoI was fortunate to see some of the 2019 projection mapping competition on odawara castle. It is absolutely mind bending technology. This is the real beginning of augmented reality, not VR or cell phones
- lm28469 7y agoMade me think of: https://youtu.be/2WPta4nioIU?t=73 https://youtu.be/2WPta4nioIU?t=73
- jes5199 7y agoYeah exactly. I want to see Dynamicland-style AR rooms based on this
- Frost1x 7y agoOne downside with this approach is that you need something to bounce the light off of (e.g., a surface), so adding virtual objects to AR is difficult if the objects aren't positioned at the surface of real world objects. That's an effect you often want to achieve in AR applications.
- elif 7y agoNah if you see it in person you understand. No matter the surface, you can create a virtual 3d space from the perspective of the observer. https://youtu.be/deJnHFQtbiE https://youtu.be/deJnHFQtbiE This gives you an idea but in person the illusion is stronger.
- binthere 7y agoI can see some big usage for this in medicine. Projecting stuff to help doctors performing complicated surgeries.
- Frost1x 7y agoI was thinking the same thing. Stryker already has a system that has a tracking device for surgeons that shows pre-OP CT scans around the area and shifts sliced around depending on the position (also performs a 3D rendering). Projecting this directly on the surface may be useful but you'd have to be careful not to skew information surgeons may find useful. Seems great for training on cadavers and stuff though.
- jes5199 7y agoif I want to do object tracking for a low-grade version of this kind of thing, what’s the best off-the-shelf solution right now? Is it ARKit?
- b0rsuk 7y agoAdvertising, advertising, advertising and dance floors.
- ebcode 7y ago> dance floors. Holy shit. https://www.youtube.com/watch?v=XkXrLZmnQ_M https://www.youtube.com/watch?v=XkXrLZmnQ_M
- mrspuratic 7y agoFootball games need more advertising... sigh.
- jeffnappi 7y agoI'd love to see Cirque du Soleil leverage this type of technology in a show...
- jbverschoor 7y agoVery cool!
- ridaj 7y agoThe latency is way more impressive than the fps Edit: the video gets the point across more effectively IMO: https://youtu.be/-bh1MHuA5jU https://youtu.be/-bh1MHuA5jU
- proc0 7y agoCould this be applied to motion capture to remove all the unnecessary gear actors have to wear? This could revolutionize digital animation.
- ajflores1604 7y agoFirst saw the on the prosthetic knowledge Tumblr account years ago. Really miss that account. Whoever was behind it did a phenomenal job of curating incredibly interesting technology developments.
- smabie 7y agoThis is just too much. My mind is completely blown. And makes me think of how many things I think are impossible but actually are or will be in the near future.
- baroffoos 7y agoSimilar feelings. The video doesn't go easy on the tech either. He is shaking that paper violently and I can't see any faults. The part where he has 2 bits of paper as well as when he stretches his shirt are mindblowing.
- jedisct1 7y agoThat could be big for the fashion industry.
- icebraining 7y agoI'm working on 3D for clothes design, and we're already exploring VR; seems like this could be really interesting too, yes.
- mixologic 7y agoSure seems like a lot of science and tech related awesomeness is introduced to the world on a website from 1998.
- tlarkworthy 7y agoDoes anyone know what camera they use is?
- raxxorrax 7y agoThat is pretty impressive. Tried something similar with a DLP projector stolen from texas instruments (not stolen, but they tend to be picky about selling them. Probably because these are awesome devices). Was slow as hell, since I used a raster with multiple images to measure the topology. The resulting heightmap was awesome, but even with synchronized camera and projector, I needed a pretty long illumination time per image. So it would be interesting what camera(s) they used too. I doubt you would need multiple projectors, because the available ones are extremely fast.
- moron4hire 7y agoBack in 2012, my wife and I attended a stage show called "The Animals and Children Took To The Streets" [0]. It was done with "dumb" projectors, with choreographed movement of different screens on the stage, but created a highly dynamic show. Remembering that show, and seeing these videos, it makes me giddy to think what could be done with the latest tech today. [0] https://www.theguardian.com/stage/2011/dec/11/animals-children-took-streets-review https://www.theguardian.com/stage/2011/dec/11/animals-childr...
- chrischen 7y agoThis would go great with the teamLab borderless exhibit, which currently seems primitive in comparison (it’s an art exhibit where they project images everywhere).
- hongzi 7y agoThis lab is doing a whole series of amazing stuff--- 500ps hand gesture recognition system: http://www.k2.t.u-tokyo.ac.jp/perception/zSpace/index-e.html http://www.k2.t.u-tokyo.ac.jp/perception/zSpace/index-e.html Robust tracking for moving objects: https://www.youtube.com/watch?v=p7IL0Gvux7U https://www.youtube.com/watch?v=p7IL0Gvux7U
- peterhil 7y agoThis could be cool at techno parties.
- abetusk 7y agoWhat kind of specs would someone need to reproduce this on a Linux system, say? Are there any FOSS projects that are doing this?
- balabaster 7y agoHaving just watched a bunch of videos on Deep Fakes after the revelation of the Deep Fake video of Nixon's Moon Landing Disaster speech on here this morning, I can't help but feel like this is something else that will make fakes more and more difficult to distinguish from genuine.
- joaodelgado 7y agoHere's a very cool art project done with this tecnology: https://www.youtube.com/watch?v=3Aos1Z2htDU https://www.youtube.com/watch?v=3Aos1Z2htDU