Polifonia: a digital harmoniser for musical heritage knowledge

Periodic Reporting for period 1 - Polifonia (Polifonia: a digital harmoniser for musical heritage knowledge)

Periodo di rendicontazione: 2021-01-01 al 2021-12-31

Europe's Musical Heritage Knowledge (MHK) is kept in many places, but they are disconnected (no links) and heterogeneous (sound, texts, scores, all variously transmitted). Scholars, memory institutions, music professionals and artists, and citizens struggle to access and retrieve MHK. Even when they can access and explore it, it is hard to identify relations across music objects, or between MHK and historical or social events.
Polifonia is about explicitly and homogeneously representing MHK, with dense interlinking and public access.
Polifonia has collected stories and use cases that hint at the need for methods and tools for (1) representing orally transmitted heritage and guaranteeing its preservation and transmission, 2) studying large and distributed digital collections of music objects and plurilingual texts, 3) discovering and representing MHK, its links to tangible cultural objects, and to their social, cultural, historical contexts, spanning several centuries and geographic areas.
Polifonia is building an ecosystem of computational methods and tools supporting discovery, extraction, encoding, interlinking, classification, exploration of, and access to, musical heritage knowledge on the Web.
Polifonia releases open source resources, methods, and software, performs dissemination actions for stakeholders and early adopters; increases the engagement of female students in STEM topics through MH-focused laboratories; supports reproducible and customisable artistic digital installation leveraging its technologies and resources; applies its results to ten pilots about preservation, management, studying and interaction with MHK, involving cultural institutes and collection owners, historians of music, anthropologists and ethnomusicologists, linguists, etc.

# Polifonia visual system: https://vimeo.com/518636055
# Polifonia Website: https://polifonia-project.eu/
# Project GitHub repository: https://github.com/polifonia-project
# RuleBook for developers: https://github.com/polifonia-project/rulebook
# The Polifonia Ecosystem (under testing): June 2022:https://polifonia-project.github.io/ecosystem/
# musoW, browsing and querying 500 MH resources: https://w3id.org/musow/
# CLEF (Crowdsourcing Linked Entities via web Form): https://github.com/polifonia-project/registry_app
# All pilots went through their first iteration, clarifying their objectives and identifying concrete materials for their experiments and demo applications.
# The Polifonia Ontology Network (PON), 10 modules addressing the representation of music objects and their context: https://github.com/polifonia-project/ontology-network
# SPARQL Anything extensions: from collections into RDF knowledge graphs: https://github.com/SPARQL-Anything/sparql.anything
# Cornucopia, music dataset metadata retrieval, description and integration
# Polifonia knowledge graph:
## SPARQL endpoint: https://arco.istc.cnr.it/polifonia/sparql https://github.com/polifonia-project/kg_sparql_endpoint#browse-the-graph
# The Ceol Rince na hÉireann (CRE) reengineered to correct MIDI version: https://zenodo.org/record/5768216#.YhtsRpPMI-R
# MIDI to LOD: https://github.com/midi-ld/midi2vec
# Music objects analysis and patterns:
## Folk ngrams analysis (FONN) tools: https://zenodo.org/record/5768216#.YbEAbS2Q3T8
## Local harmonic agreement based on recurrent patterns (LHARP): https://github.com/polifonia-project/lharp
## abstract tree-based model to index music content - faceted search engine deployed for NEUMA: http://neuma.huma-num.fr/
# Software for text corpus population and OCR software: https://github.com/polifonia-project/textual-corpus-population
# Polifonia specialised lexicon for MH (~4000 concepts): https://github.com/polifonia-project/Polifonia-Lexicon
# Polifonia plurilingual text corpus (~250000 texts): https://github.com/polifonia-project/Polifonia-Corpus
# Interacting with MH objects and knowledge:
## ODP Reactor, knowledge graph visualisation based on ontology design patterns: https://github.com/ccolonna/odp-reactor/projects
## A thorough study on existing user interaction practices has been developed to design (and implement) an interactive tool supporting the exploration of music data and knowledge, in association with listening experiences
## Haptic devices for supporting the ACCESS pilot
## Design of specialized dashboards for heritage objects data visualization ongoing – each dashboard addresses one pilot and addresses several object visualization patterns
## Musilar, interactive interface for browsing and querying harmonic similarity graphs: https://polifonia-project.github.io/musilar-preview/
# Stakeholder network: 12 members, +18 to be invited during year 2
# The first stakeholder workshop is planned for next Autumn
# Workshop on Multisensory Data & Knowledge at LDK: collaboration between Polifonia and Odeuropa consortia (01/09/21): https://odeuropa.github.io/mdk21/
# Active participation at DARIAH Working Group AIM. Presentation in an online event: https://polifonia-project.eu/re-watch-artificial-intelligence-and-musics-october-meeting/
# Polifonia @ Sonar AI&Music festival 2021:
## Polifonia keynote and research demo at AI&Music - Sonar festival Barcelona (2021): https://polifonia-project.eu/re-watch-polifonia-presentation-at-ai-music-festival-sonar/
## Sonar interface design and demo - interaction combining listening experience with exploration of musical content and Knowledge: https://github.com/polifonia-project/sonar2021_demo/issues/2 https://polifonia-project.github.io/sonar2021_demo/home
All pilots went through their first iteratio by contributing to requirements elicitation through definition of stories/personas, by providing support to the ontology design team, by collecting texts and datasets, by acquiring and digitising relevant material to be analysed, by identifying targets for knowledge extraction through interviews with experts. Some early prototype are already available, others are under development.

Polifonia knowledge graphs and methods fosters advancement in music data interoperability and links between tangible and intangible entities (integration and extension of music notation ontologies; ontologies of multiple music contexts, including textual knowledge; associating notation patterns and contexts such as places, time, events; MHK copyright and provenance semantics).
Polifonia large-scale MHK analysis advances extraction of MHK patterns, applying them in the pilots, and supporting their use by stakeholders. That pattern layer is an asset for global exploration and discovery across MHK.
Polifonia advances large scale knowledge analysis of texts on musical heritage, discovering spatio-temporal data, agents, places, experiences, opinions, perceptions, cross-cultural perspectives.
Polifonia provides a web portal with a registry of resources, their provenance, a meta-search engine and other advanced query and exploration interfaces: visual, gestural, haptic.

Polifonia logo

Periodic Reporting for period 1 - Polifonia (Polifonia: a digital harmoniser for musical heritage knowledge)

Condividi questa pagina

Scarica