Cel
"MUSMAP develops research on the topic of auditory-motor interaction, using music performance as a case study. The project will address methodological and technological challenges in the development of multi-modal data acquisition and analysis methods for the construction of auditory-motor patterning schemes, with the aim of modelling instrumental playing technique from a computational perspective. Violin performance, which involves time-continuous feedback adaptations through tightly-coupled action-perception interaction, represents a rich and underexplored case study.
The research to be pursued in MUSMAP is divided into three main parts:
(1) To utilize multi-modal data acquisition and analysis methods to develop and validate auditory-motor pattern representation models by creating and systematically studying an extensive set of violin performance multi-modal recordings of trained musicians.
(2) To apply auditory-motor pattern representations to design a system for automatic control of violin sound synthesis presenting a closed-loop, feed-forward architecture by which a motor sequencing component is updated in response to perceptual features of synthesized sound. Beyond its interest as a promising technology for upcoming computer-aided music production frameworks, the system represents an ideal test bed for validating the auditory-motor representation models developed as part of objective (1).
(3) To apply auditory-motor pattern representations to develop novel, high-quality sound processing technologies through which meaningful audio perceptual attribute manipulations are driven by motor primitives, enabling auditory-motor remapping of recorded or real-time violin performances. In collaboration with top-class institutions specialized in cognitive neuroscience aspects of sensory-motor interaction, developed technologies will be used to propose and execute novel experiments involving the manipulation of a musician’s auditory experience when performing and listening."
Zaproszenie do składania wniosków
FP7-PEOPLE-2012-IOF
Zobacz inne projekty w ramach tego zaproszenia
System finansowania
MC-IOF - International Outgoing Fellowships (IOF)Koordynator
08002 Barcelona
Hiszpania