Sean Yeh

Kinect + Overtone Project

The Kinect Overtone Installation is a media art project to experiment with using physical gestures to modify sound. For example, one aspect was using hand movements to control the speed of a MIDI file being played — almost acting as a conductor of sorts.

As the name suggests, I used an Xbox Kinect for the motion sensor and Overtone, a Clojure toolkit for programming music. I also created visual effects with Processing. Check out the code here.

In my final year at Juilliard, I set up a multimedia installation in the school lobby, where passersby could watch and interact with it.

Unfortunately, I was not able to get a video recording of the installation, but below are some pictures that were taken of the event.