Skip to main content
Go to the home page of the European Commission (opens in new window)
English en
CORDIS - EU research results
CORDIS

Performance Precision Annotator (PPA): AI-Assisted Annotation and Analysis of Music Performance

Project description

AI-driven tool for music analysis and annotation

Thanks to the internet, sound recordings and musical scores are easily accessible. But connecting these two mediums for insights into performance style and artistic expression requires significant time and effort. Music scholars currently rely on general-purpose sound editing tools to annotate musical elements in recordings. However, these annotations are entered manually, and the tools do not integrate musical score information. The EU-funded PPA project aims to bridge this gap by creating an open-source software tool, the Performance Precision Annotator (PPA), designed for annotating and analysing recorded music performances. The project will empower the software with a digital musical score and a performance recording to automatically generate insightful artificial intelligence-driven annotations for note onsets, dynamics, articulations and tempo.

Objective

In the internet era, vast troves of sound recordings and musical scores have become available to virtually anyone, but drawing connections between these two mediums to develop insights about performance style and artistic expression has remained a difficult and time-consuming task. Currently, music scholars rely on general--purpose sound editing tools for annotating musical elements in recordings (such as downbeats, pitch, or note onsets); however, these annotations often must be entered manually, and these tools do not incorporate one vital element needed for analyzing recordings: musical score information. This approach can be labor intensive and inefficient, and limits the scope of the data that can be analyzed. To help address this need, we seek this fellowship to develop PPA, a prototype open--source software tool for annotating and analyzing recorded music performances, bringing innovations from the interdisciplinary Music Information Retrieval (MIR) community to scholars and musicians in the humanities. Provided with a (digital) musical score and a performance of that score, the software will automatically generate meaningful AI--driven annotations about (e.g.) note onsets, dynamics, articulations, or tempo, fully integrated with the score. With an easy--to--use graphical user interface, the software will display and visualize the score, the audio, and the selected annotations in intuitive ways designed to streamline performance analysis. Besides developing the prototype, we propose to conduct use-case studies, gathering evidence to illuminate ways PPA can be used to assist musicology scholarship, and to inform future development of the software.

Fields of science (EuroSciVoc)

Keywords

Programme(s)

Topic(s)

Funding Scheme

HORIZON-TMA-MSCA-PF-EF - HORIZON TMA MSCA Postdoctoral Fellowships - European Fellowships

See all projects funded under this funding scheme

Call for proposal

(opens in new window) HORIZON-MSCA-2022-PF-01

See all projects funded under this call

Coordinator

UNIVERSITAT FUR MUSIK UND DARSTELLENDE KUNST WIEN
Net EU contribution
€ 99 450,52
Address
ANTON VON WEBERN PLATZ 1
1030 WIEN
Austria
Region
Ostösterreich Wien Wien
Activity type
Higher or Secondary Education Establishments
Links
Total cost
No data