Digital Scores – investigating the technological transformation of the music score

Project Information

DigiScore

Grant agreement ID: 101002086

DOI

10.3030/101002086

EC signature date 11 June 2021

Start date 1 October 2021

End date 30 September 2026

Funded under

• EXCELLENT SCIENCE - European Research Council (ERC)

Total cost

€ 1 999 985,00

EU contribution

€ 1 999 985,00

Coordinated by

THE UNIVERSITY OF NOTTINGHAM
United Kingdom

Periodic Reporting for period 2 - DigiScore (Digital Scores – investigating the technological transformation of the music score)

Reporting period: 2023-01-01 to 2024-09-30

Summary of the context and overall objectives of the project

The DigiScore project investigates the transformation of the music score through computational technologies, specifically its effect upon creativity, musicianship, accessibility and innovation. This is because digital scores utilising computational technology and digital media are emerging worldwide as the next evolutionary stage in the concept of the music score. On one end of the scale iPad hosting scrolling images of traditional notation can follow musicians as they play. On the other end of the scale of innovation, AI, robotics and gaming technologies are being utilised to complete the music score in the moment and interact with the human musicians in the completion of the composition. Overall, they are generating new music experiences, innovative compositional approaches, novel performance opportunities, and broader accessibility for a vast number of musicians and music cultures around the world. Yet there has been no scientific study of digital scores; nor their effect upon creativity and musicianship. This is remarkable for two reasons:
- First, because digital scores are generating new music experiences, innovative compositional approaches, novel performance opportunities, and broader accessibility for a vast number of musicians and music cultures around the world.
- Second, because many topics immediately adjacent or informing digital scores have been theorised thereby liberating these subjects and innovating creative practices, e.g. digital media art, digital performance, electro-acoustic music.

The core aims of the project are to:
(1) determine scientific knowledge of how digital scores stimulate new creative opportunities and experiences within a range of music practices,
(2) develop a theoretical framework for digital scores as an important transdisciplinary area of research,
(3) build a scientific study of inclusive digital musicianship through the transformative potential of the digital score.

Work performed from the beginning of the project to the end of the period covered by the report and main results achieved so far

The work performed to date aligns to the two main work packages (WP). The work conducted in WP1 includes a series of trans-disciplinary discussions and interviews that expand the theoretical context into areas and disciplines beyond music. This has built a theoretical proposition that is being tested through the analysis of the practice-based work (WP2). The insights from WP1 are informing case study design across the consortium (WP2) and are being disseminated through the project website as a series of blogs and initial analyses of the practice.

WP2 is the “engine house” of this project, this is where the theory and practice of digital score “musicking” (making music (Small 1989)) converge through a series of practice-based activities:

- 1, a series of commissions and performances by professional musicians who design, construct, create and perform innovative digital score using the 7 tech themes of the project (e.g. AI, robotics, networking, games). By working intensively inside these digital scores, they are able to form profound experiences. These experiences are the focus for the primary scientific data of this project, and we have developed a robust methodology that extracts their reflexion to these experiences across the lifespan of the case study. So far, we have conducted almost 30 such analyses through 15 projects worldwide; and presented the findings in conference proceedings, journal articles and book chapters.
- 2, we are conducting a world-wide study to evaluate higher education music students’ wants and needs from digital musicianship education across the globe through engagement with digital scores. This is conducted through a combination of lectures, workshops, concert rehearsals and creativity card projects. To date we have conducted these across Europe, North America, Canada, the Caribbean, and about to embark on a roadshow of Australasia then Brazil. We have written about our provisional findings in several conference proceedings.

There have been two profound surprises through the course of WP2 that are now the focus of our work for the second phase of this project: first is the impact and transformational potential of the digital score as a platform for inclusivity and accessible musicking for disabled musicians (e.g. Jess+ https://digiscore.github.io/pages/Impact_case_study_Jess_Plus/ and https://www.youtube.com/watch?v=_dvSiwzC0N0 ), and the wider interest in human-AI musicking through the lens of digital scores.

Progress beyond the state of the art and expected potential impact (including the socio-economic impact and the wider societal implications of the project so far)

Progress beyond the state of the art has happened in several discrete areas:

First, the volume of qualitative analysis of musicians making, performing and experiencing digital scores is an unparalleled study. Because of the depth of interrogation and analysis due to a robust methodology we are drawing out significant features and patterns of meaning-making for musicians that influences practice inside and outside academia.

The inclusivity and accessibility theme embedded into the study, emerged early on as an important aspect of this research. To date we have engaged with 4 inclusivity-focussed projects each of which are presenting life-changing impact to the disabled musicians involved. This is due to the theoretical and artistic grounding of the digital score concept.

A new theme is emerging that focusses on human-AI and human-robotic music-making. In these instances the AI and the robot are conceptualised as a digital score. A new methodology is being developed that is mixed-mode extending our qualitative process with a body-data approach and quantitative measuring and analysis in order to ascertain evidence of togetherness and creativity.

The academic influence of this research is growing, with citations and mentions building steadily. Other ERC and EU grants are seeking collaboration, and off-shoot projects are being developed with international partners. Currently a ERC PoC application is being developed.

The international partners are still developing innovative case studies which will be included in our corpus, and over the coming 18 months will form the bulk of new projects. At the University of Nottingham base we will be digging much deeper into 2 new themes:

1. corpus analysis - we are developing an AI that will systematically analysis the corpus of data we have been collecting from the qualitative process, and unearthing new insights.
2. longitudinal study of human-AI digital score musicking within blended ensembles of disabled and non-disabled musicians with AI digital scores.

Jess+ Digital Score performed at the BBC. Credit BBC R&D