The suggested project will materialize a general framework for such online analysis of gesture, and will implement it in the form of a tool, used for the processing of complex piano notation: a real-time “overwriting” of the score in the form of a personalized, malleable, multi-layered “tablature” (visible) and/or interface (graspable). The general methodology is designed along the development of the gesture follower by the ISMM Team: Machine learning techniques and temporal mapping, comparing the incoming dataflow with stored templates, characterize the proposed gestural analysis.

In collaboration with the ISMM Team.