Periodic Reporting for period 1 - REPERTORIUM (Researching and Encouraging the Promulgation of European Repertory through Technologies Operating on Records Interrelated Utilising Machines)
Berichtszeitraum: 2023-01-01 bis 2024-02-29
The REPERTORIUM project seeks to harness the transformative powers of Artificial Intelligence (AI) and digital technologies to revolutionize the accessibility, understanding, and dissemination of European classical and medieval music heritage, enhance music streaming revenues, and empower professional, student, and amateur musicians. REPERTORIUM will result in a suite of AI tools to protect and explore Europe’s ancient musical roots and which develop out of this heritage innovative technological solutions to empower the future of the music industry. AI is employed to digitise ancient and classical manuscripts, preserve European musical heritage, and create state-of-the-art sound processing technologies, including metaverse-ready immersive audio. Vast collections of music manuscripts, often tucked away in monasteries, libraries, and archives remain underutilized, locked in physical formats that preclude broad public engagement and scholarly exploration. REPERTORIUM aims to digitize, catalogue, and create comprehensive databases of European art-music works.
The project's ambitious goals include the development of advanced AI tools for the accurate digitization of handwritten scores, both in classical and medieval neumatic notations, and the deployment of innovative Sound Source Separation (SSS) and Spatial Audio technologies tailored for classical music. These technologies promise to unlock new possibilities for music education, research, and entertainment, offering immersive streaming experiences and interactive digital concerts that can reach a global audience.
Moreover, REPERTORIUM places a strong emphasis on the societal and economic impacts of its technological advancements. By making Europe's musical heritage more accessible and engaging through digital means, the project supports cultural preservation, educational initiatives, and the growth of the classical music industry. The integration of spatial audio technologies and immersive concert experiences aims to rejuvenate the appeal of classical music, fostering new audiences and enhancing the streaming market. By facilitating digital access to musical works, REPERTORIUM reduces the carbon footprint associated with physical travel and the consumption of paper-based resources.
The involvement of social sciences and humanities is crucial to the project, ensuring that technological innovations are grounded in a deep understanding of musicology, historiography, and cultural studies. This interdisciplinary approach not only enriches the project's technological endeavors but also ensures that its outcomes are relevant, accessible, and meaningful to a wide range of stakeholders, from academics and musicians to the general public. These technologies are the foundation of a general musical artificial intelligence that fully unleashes the powers of machine learning upon the domain of European classical heritage, advancing us towards a human-centred digital world.
In summary, REPERTORIUM is set to make a substantial contribution to the preservation, accessibility, and enjoyment of Europe's musical heritage. Its success could serve as a model for similar initiatives in other cultural domains, demonstrating the power of integrating technology, humanities, and social sciences to address complex challenges and meet diverse societal needs.
The project's ambitious goals include the development of advanced AI tools for the accurate digitization of handwritten scores, both in classical and medieval neumatic notations, and the deployment of innovative Sound Source Separation (SSS) and Spatial Audio technologies tailored for classical music. These technologies promise to unlock new possibilities for music education, research, and entertainment, offering immersive streaming experiences and interactive digital concerts that can reach a global audience.
Moreover, REPERTORIUM places a strong emphasis on the societal and economic impacts of its technological advancements. By making Europe's musical heritage more accessible and engaging through digital means, the project supports cultural preservation, educational initiatives, and the growth of the classical music industry. The integration of spatial audio technologies and immersive concert experiences aims to rejuvenate the appeal of classical music, fostering new audiences and enhancing the streaming market. By facilitating digital access to musical works, REPERTORIUM reduces the carbon footprint associated with physical travel and the consumption of paper-based resources.
The involvement of social sciences and humanities is crucial to the project, ensuring that technological innovations are grounded in a deep understanding of musicology, historiography, and cultural studies. This interdisciplinary approach not only enriches the project's technological endeavors but also ensures that its outcomes are relevant, accessible, and meaningful to a wide range of stakeholders, from academics and musicians to the general public. These technologies are the foundation of a general musical artificial intelligence that fully unleashes the powers of machine learning upon the domain of European classical heritage, advancing us towards a human-centred digital world.
In summary, REPERTORIUM is set to make a substantial contribution to the preservation, accessibility, and enjoyment of Europe's musical heritage. Its success could serve as a model for similar initiatives in other cultural domains, demonstrating the power of integrating technology, humanities, and social sciences to address complex challenges and meet diverse societal needs.
The REPERTORIUM project aims to revolutionize access to and appreciation of European musical heritage using AI and spatial audio technologies. Key scientific endeavors include implementing affordable spatial audio for concert streaming to attract younger audiences, pioneering AI-based Sound Source Separation (SSS) for classical music instrument separation useful in education and training, enhancing Optical Music Recognition (OMR) for digitizing ancient manuscripts, and developing an AI-based Music Information Retrieval (MIR) tool for cataloging medieval manuscripts, identifying duplicates and similarities. Technological activities focus on digitizing and cataloging medieval manuscripts for accessibility through databases like DIAMM and MMMO, ensuring data interoperability to avoid duplicates, and enabling immersive VR music experiences for the Metaverse, including "minus-one" practice options. REPERTORIUM seeks to bridge the gap between historical musical works and modern audiences, enhancing music education, preservation, and enjoyment through innovative technology.
REPERTORIUM merges OMR, SSS, and spatial audio tech to advance multimedia research, offering real-time processing and deep learning (DL) innovations for market transition. Post-COVID-19, it addresses the digital audience's growth, enhancing Metaverse-ready streaming with immersive tools. It promotes European cultural preservation by digitizing medieval and classical works into accessible databases, revolutionizing manuscript digitization methods. Gregorian chants recorded will be globally accessible via the Neumz app, supporting archival efforts across cultures at lower costs. REPERTORIUM introduces services linking scores and recordings to databases for immersive streaming experiences, benefiting ensembles, educators, and publishers by facilitating digital access and new editions, enriching cultural dialogue and heritage access.