6 ms·

The second generation of the projection tech does color: http://www.k2.t.u-tokyo.ac.jp/vision/dynaflashv2/index-e.html http://www.k2.t.u-tokyo.ac.jp/vision/dyna

The second generation of the projection tech does color: http://www.k2.t.u-tokyo.ac.jp/vision/dynaflashv2/index-e.html http://www.k2.t.u-tokyo.ac.jp/vision/dynaflashv2/index-e.htm... And they can now do the tracking without the infrared paint: http://www.k2.t.u-tokyo.ac.jp/vision/MIDAS/index-e.html http://www.k2.t.u-tokyo.ac.jp/vision/MIDAS/index-e.html

SiempreViernes 7y ago
Very cool, a sort of live-action cgi capability. Hope it doesn't easily scale out to larger spaces and crowds, or the current tech industry would soon have public spaces filled with ads projected on peoples belongings.
- Frost1x 7y ago
  Going to start ordering everything coated in vantablack then... https://en.m.wikipedia.org/wiki/Vantablack https://en.m.wikipedia.org/wiki/Vantablack
  - ryanmcbride 7y ago
    Unless you're Anish Kapoor you'll have to settle for Black 3.0 https://www.culturehustleusa.com/products/black-3-0-the-worlds-blackest-black-acrylic-paint-150ml https://www.culturehustleusa.com/products/black-3-0-the-worl...
    - panopticon 7y ago
      Plus, Black 3.0 isn't toxic like Vantablack.
      - matt4077 7y ago
        ...or Anish Kapoor.
        legel 7y ago
        Who makes a fine mirror.
- throwaway744678 7y ago
  The target needs to be marked with infrared ink: you can project only on specific surfaces prepared in advance. Edit: discard this comment, I misread the parent comment.
  - make3 7y ago
    no? the second link showed that it doesn't have to
  - JoshTriplett 7y ago
    Not according to the comment that started this thread, which suggests that they no longer need the infrared paint.
- FroshKiller 7y ago
  The tech industry would soon have some very expensive equipment destroyed.
- drumttocs8 7y ago
  I doubt it would ever be used on private property like that, but we absolutely will see this tech used in the advertising space.
  - deleted 7y ago
    [deleted]
- aaron695 7y ago
  > public spaces filled with ads projected on peoples belongings. They literally could have done this for 100+ years. They do not. Do you see how what you say makes no sense other than a fear of technology? You've seen projectors, you've seen how they don't just project them anywhere, it's hard to see how one makes this leap.
make3 7y ago
wow they even added shading, to do fake lighting effects
aledalgrande 7y ago
That second one is insane! I can't get my head around how they would be able to do it.
saganus 7y ago
That is just stunning. I guess Disney Imagenineering dept. would love to do some cools things with this. Or perhaps they already have this capability? These are the kind of things were I'd like to have a commercial version already! Edit: Also, the url in the original post is from 2016! wow! (@dang maybe add (2016) to the title?)
- deleted 7y ago
  [deleted]
- CobrastanJorji 7y ago
  Disney has a (poor) version of this idea. They project an animation onto wedding cakes at their resorts. They're pre-rendered though, rather than dynamic like this. It'd be fascinating to see what uses they could come up with for this stuff.
  - Junk_Collector 7y ago
    Disney uses something similar in a lot of their stage shows at their parks. They use a water fountain to create a screen and project onto the water sheet. It works surprisingly well, but I would assume that it is pre-rendered.
    - patmorgan23 7y ago
      The water screens are actually a pretty old technique that you can do with any traditional light projector (flim or digital). The hard part is making the water sheet.
  - JonathonW 7y ago
    Disney does a lot of projection mapping in the parks right now, but it's all (AFAIK) the traditional, pre-rendered type, with animations projected onto large static surfaces like the Magic Kingdom's castle, or onto animatronics with pre-planned motion paths. I'm having a little trouble visualizing how this non-rigid projection mapping could get applied in a practical way in the parks today, mostly because it seems like it has a fairly small "active" area (determined by your projector and sensor resolution, essentially). I could imagine this being used in a parade or stage show, for example, but this system seems like it would be pretty restrictive as to where the performers could move and remain in the projection space.
samstave 7y ago
I cant describe how awesome this is to me, personally. In 1998 I was hired on a contract to do a Fashion Show, where I developed graffix to project onto models who were on the catwalk in this theater.... Basically it was a music + visuals show where the models would walk down the catwalk and present themselves.... Guess what tool I had available to me to make this happen... FUCKING POWERPOINT I F5'd that bitch and projected a slide per model on a projector borrowed from work with me manually changing slides with --> for each model....
- Escapado 7y ago
  Lost my shit reading this. Thank you so much for sharing this.
gao8a 7y ago
I hope to see this at the next Tool concert
- wajdix 7y ago
  This is what popped in my head while watching the video!
rebuilder 7y ago
The second example doesn't, IMO, demonstrate the kind of deformation tracking the example in the OP does. As far as I can tell, they are able to get a depth representation, segment objects from a video, get an approximation of surface normals and reflectivity for those objects, and project a shaded surface onto those objects. What they do not seem to be able to do without IR markers is project a diffuse texture to an object so that it would stick properly. See the one example with a non-uniform texture, where the fingers of a hand are fanned out - the texture warps noticeably.
- that_jojo 7y ago
  You say that like it's not ridiculously impressive and interesting. Could you imagine using something like this for reviewing finish options for a product with zero turnaround time?
  - rebuilder 7y ago
    It is impressive, but it's not an improvement on the tech in the OP - it's a different approach to a similar problem as far as I can tell.

SiempreViernes 7y ago

Very cool, a sort of live-action cgi capability. Hope it doesn't easily scale out to larger spaces and crowds, or the current tech industry would soon have public spaces filled with ads projected on peoples belongings.

Frost1x 7y ago
Going to start ordering everything coated in vantablack then... https://en.m.wikipedia.org/wiki/Vantablack https://en.m.wikipedia.org/wiki/Vantablack
- ryanmcbride 7y ago
  Unless you're Anish Kapoor you'll have to settle for Black 3.0 https://www.culturehustleusa.com/products/black-3-0-the-worlds-blackest-black-acrylic-paint-150ml https://www.culturehustleusa.com/products/black-3-0-the-worl...
  - panopticon 7y ago
    Plus, Black 3.0 isn't toxic like Vantablack.
    - matt4077 7y ago
      ...or Anish Kapoor.
      - legel 7y ago
        Who makes a fine mirror.
throwaway744678 7y ago
The target needs to be marked with infrared ink: you can project only on specific surfaces prepared in advance. Edit: discard this comment, I misread the parent comment.
- make3 7y ago
  no? the second link showed that it doesn't have to
- JoshTriplett 7y ago
  Not according to the comment that started this thread, which suggests that they no longer need the infrared paint.
FroshKiller 7y ago
The tech industry would soon have some very expensive equipment destroyed.
drumttocs8 7y ago
I doubt it would ever be used on private property like that, but we absolutely will see this tech used in the advertising space.
- deleted 7y ago
  [deleted]
aaron695 7y ago
> public spaces filled with ads projected on peoples belongings. They literally could have done this for 100+ years. They do not. Do you see how what you say makes no sense other than a fear of technology? You've seen projectors, you've seen how they don't just project them anywhere, it's hard to see how one makes this leap.

make3 7y ago

wow they even added shading, to do fake lighting effects

aledalgrande 7y ago

That second one is insane! I can't get my head around how they would be able to do it.

saganus 7y ago

That is just stunning. I guess Disney Imagenineering dept. would love to do some cools things with this. Or perhaps they already have this capability? These are the kind of things were I'd like to have a commercial version already! Edit: Also, the url in the original post is from 2016! wow! (@dang maybe add (2016) to the title?)

deleted 7y ago
[deleted]
CobrastanJorji 7y ago
Disney has a (poor) version of this idea. They project an animation onto wedding cakes at their resorts. They're pre-rendered though, rather than dynamic like this. It'd be fascinating to see what uses they could come up with for this stuff.
- Junk_Collector 7y ago
  Disney uses something similar in a lot of their stage shows at their parks. They use a water fountain to create a screen and project onto the water sheet. It works surprisingly well, but I would assume that it is pre-rendered.
  - patmorgan23 7y ago
    The water screens are actually a pretty old technique that you can do with any traditional light projector (flim or digital). The hard part is making the water sheet.
- JonathonW 7y ago
  Disney does a lot of projection mapping in the parks right now, but it's all (AFAIK) the traditional, pre-rendered type, with animations projected onto large static surfaces like the Magic Kingdom's castle, or onto animatronics with pre-planned motion paths. I'm having a little trouble visualizing how this non-rigid projection mapping could get applied in a practical way in the parks today, mostly because it seems like it has a fairly small "active" area (determined by your projector and sensor resolution, essentially). I could imagine this being used in a parade or stage show, for example, but this system seems like it would be pretty restrictive as to where the performers could move and remain in the projection space.

samstave 7y ago

I cant describe how awesome this is to me, personally. In 1998 I was hired on a contract to do a Fashion Show, where I developed graffix to project onto models who were on the catwalk in this theater.... Basically it was a music + visuals show where the models would walk down the catwalk and present themselves.... Guess what tool I had available to me to make this happen... FUCKING POWERPOINT I F5'd that bitch and projected a slide per model on a projector borrowed from work with me manually changing slides with --> for each model....

Escapado 7y ago
Lost my shit reading this. Thank you so much for sharing this.

gao8a 7y ago

I hope to see this at the next Tool concert

wajdix 7y ago
This is what popped in my head while watching the video!

rebuilder 7y ago

The second example doesn't, IMO, demonstrate the kind of deformation tracking the example in the OP does. As far as I can tell, they are able to get a depth representation, segment objects from a video, get an approximation of surface normals and reflectivity for those objects, and project a shaded surface onto those objects. What they do not seem to be able to do without IR markers is project a diffuse texture to an object so that it would stick properly. See the one example with a non-uniform texture, where the fingers of a hand are fanned out - the texture warps noticeably.

that_jojo 7y ago
You say that like it's not ridiculously impressive and interesting. Could you imagine using something like this for reviewing finish options for a product with zero turnaround time?
- rebuilder 7y ago
  It is impressive, but it's not an improvement on the tech in the OP - it's a different approach to a similar problem as far as I can tell.