Table of Contents

Conducting Music - Mapping Movements to Measures

Authors Harald Grohganz, Sebastian Böck, and Sebastian Stober
Affiliation University of Bonn, Johannes Kepler University Linz, Western University London (Ontario)
Code Github Link

In this project, we contributed some Machine Learning techniques which may lead to an advanced “conductible” MIDI player. At the end, this player might provide tempo control by hand gestures in real-time.

Interface

The interface mainly consists of a MIDI player which provides the actual position within each measure during playback. To detect the conductor's movement, we use Dense Optical Flow - hence it is not necessary to track a conductor's hand or baton. This is some previous work, written entirely in Java.

Our goals at HAMR:

Future work:

The Model

Will be presented.