Nice... a reasonable next step for this prototype would be to recognize finger tips (via some kind of glove) so you can start interacting with the virtual scene

Nice... a reasonable next step for this prototype would be to recognize finger tips (via some kind of glove) so you can start interacting with the virtual scene (I remember seeing something like this elsewhere...) -- my first instinct was to try to smush that green monster :)