The Movement Lab of New York University, in collaboration with the New
York Times, installed multiple high-speed motion capture cameras in a
studio of the Juilliard School at New York's Lincoln Center in order
to study the movement of Alan Gilbert, world renowned Conductor and
Music Director of the New York Philharmonic. Reflective markers were
placed strategically on the conductor's body. Since Gilbert did not
conduct the day's musical program with a baton, the crew devised a
novel finger capture method to record his hands. Using advanced
computer software with new visualization techniques, the team
transformed this motion data, tracing the intricacies of Gilbert's
gestures and the movement behind the music. The video below shows
highlights of the technical process behind the resulting interactive
feature that accompanies the New York Times feature The Maestro's Mojo.