Sound Artist Uses Microsoft Kinect To Translate His Gestures Into Commands To Control Music

The world premiere and only performance of “Above, Below, and In Between,” a composition conducted in part by Kinect and performed by members of the Seattle Symphony. The piece was a partnership with kinetic sculptor and sound artist, Trimpin. Kinect sensor responded to his gestures and translated them into commands for three kinetic instruments: a 24-reedhorn sculpture, a set of concert chimes, and a robotic grand piano.

The performance took place in the grand lobby of Benaroya Hall, the home of the Seattle Symphony, with the musicians, singers, and the kinetic instruments strategically placed to benefit from the lobby’s architectural and acoustical characteristics. The Kinect sensor was located in front of the conductor’s stand, where it tracked Morlot’s movements and relayed them to the kinetic instruments, allowing the conductor to start and stop the instruments and control their volume with arm and hand gestures.

Read more about it here.

Some links in the article may not be viewable as you are using an AdBlocker. Please add us to your whitelist to enable the website to function properly.