REPERTORIUM combined artificial intelligence with advanced spatial audio technologies to transform how European musical heritage is accessed, studied, and experienced. Its ambition was not only to digitise the past, but to reactivate it, bridging medieval and classical sources with contemporary digital innovation.
In manuscript digitisation, the project processed more than 350,000 images from historical collections. Nearly 1,000 medieval manuscript pages and over 1,300 eighteenth-century opera arias were manually annotated to create high-quality training material for AI systems. Optical Music Recognition (OMR) tools achieved 92.47% accuracy for musical note recognition, while Music Information Retrieval (MIR) tools were trained and validated on real historical sources. The resulting chant indexing system reached approximately 80% accuracy and was integrated into a fully operational musicological workspace available for public reuse. In total, 1,250 manuscripts were catalogued, more than 156,000 chants from 138 manuscripts were indexed, and 159 new Cantus IDs were created for previously unrecorded chant variants, establishing a sustainable and interoperable European research infrastructure connected to major international repositories.
In parallel, REPERTORIUM advanced the state of the art in orchestral Sound Source Separation under realistic recording conditions. The project demonstrated reliable section-level separation and effective close-microphone debleeding, integrated into a browser-based immersive streaming platform enabling interactive rehearsal, "minus-one" performance modes, and spatial remixing. Two Sound Field Reconstruction algorithms achieved an "Excellent" rating in subjective MUSHRA evaluations.
The immersive platform represented a major technological milestone. Designed as a scalable, web-native system, it combined sound-field reconstruction, Higher-Order Ambisonics rendering, 3DoF and 6DoF interaction, multi-camera 360° video, and AI-driven source manipulation within a single environment. Public demonstrations with the London Philharmonia, the Brandenburg Symphony Orchestra, and the Lithuanian National Philharmonic confirmed both technical maturity and artistic relevance. Six promotional concerts were held across Europe, and the project exceeded its dissemination targets, producing 25 scientific publications and reaching audiences through 31 conferences and 12 workshops.
Beyond technological innovation, the project generated tangible cultural impact. Recovered Gregorian chant repertoire was brought back to life through live performance and commercial recording, while previously unpublished eighteenth-century operatic works were edited and reintroduced into concert programmes. Clear exploitation pathways were defined for immersive streaming services and educational minus-one tools, with strong potential for scale-up through European innovation funding.
