Oh! I did something a little like this with a leapmotion for a hackathon once. https://github.com/AlexChesser/SpacePiano https://github.com/AlexChesser/SpacePi

Oh! I did something a little like this with a leapmotion for a hackathon once. https://github.com/AlexChesser/SpacePiano https://github.com/AlexChesser/SpacePiano There was also some on page visualization (basically copy and pasted from mr-doob) We managed to make the hand tracking work in 2 dimensions, left and right would travel along the scale (like a piano) while up and down would modulate your volume. Not sure the code would work if you checked it out and tried to run it today, but it definitely ran on the day.