Periodic Reporting for period 3 - PMSB (Principles of Musical Structure Building: Theory, Computation, and Cognition)
Reporting period: 2021-03-01 to 2022-08-31
(A) The theoretical strand is devoted to the investigation of formal principles that govern musical syntax and structure building in Western and non-Western music. Many current approaches share the expressive power of (tree-based) context-free grammars and are mostly confined to harmonic syntax only. Therefore, they face difficulty in expressing certain essential syntactic phenomena in music. To address this lacuna, the theoretical strand sets out to develop a novel unified theory of musical syntax that reconciles harmonic structure with dependencies at the level of the single note and voice leading within a single coherent framework.
(B) Addressing the lack of machine-readable corpora in music research, a large corpus of digitized syntactic analyses are to be compiled and published in the context of the project’s computational strand. Further, the unified syntax theory will be implemented based on a generalized parsing approaches and graph grammars, and trained and evaluated using the analytical corpus.
(C) The formal framework developed in (A) entails specific predictions about mental representations of musical structure and cognitive processes, which will be empirically tested in the experimental strand of the project. Particular focus will be on aspects of nonlocal dependency relations, learnability, revision, and tension. The outcomes of the project will make a significant contribution to both the field of music cognition and to the cognitive sciences in general.
In the theoretical line of the project several advancements have been made with regard to different musical parameters, in particular, harmony (chord sequences), extended tonality, rhythm, melody, polyphony and voice-leading. So far, these resulted in articles on the syntax of Jazz harmony, rhythm, and North-Indian melody.
In the computational line of the project two applications to annotate musical pieces with expert analyses are developed. This resulted in a published digital database of hierarchical analyses of Jazz chord sequences. In addition, several computational models were developed, which process syntactic structure in music and learn grammars and their properties from examples (so called parsing and grammar inference). In order to approximate complex hierarchical structure in music, another model of hierarchical key scapes was developed. In order to model properties of extended tonality (which occurs in Western music from the 19th century on), a statistical tonal diffusion model was developed, which models pitch distributions over the geometric pitch space of the Tonnetz.
In the experimental line of the project, several behavioral experiments examining listeners’ perception of syntactic structures in music were carried out. One published study examined the interaction between harmony (chords) and voice-leading (the melodic lines of single notes). A novel method to study the phenomenon of musical revision was developed and used to study how listeners reanalyze a fragment of music after they hear new continuations that are in conflict with previous hearings. Furthermore, new methods for examining hierarchicality and embedding in music were designed, which are currently being explored.
- a formalization of extended harmony and Tonfeld theory
- a model of polyphonic musical syntax based on graph grammars
- a general model of hierarchical scapes
- a formalization of aspects of musical syntax that generalize to Non-Western music, exemplified for Classical North Indian music
- Further experimental results on listeners’ processing and mental representation of syntactic structures in music.