Periodic Reporting for period 3 - Polifonia (Polifonia: a digital harmoniser for musical heritage knowledge)
Okres sprawozdawczy: 2023-03-01 do 2024-04-30
Polifonia aims at increasing the amount of knowledge about musical heritage available on the web in a form that is easily accessible both by humans and machines. The project contributes to advance knowledge engineering methodologies and tools, to produce new and align existing music ontologies and knowledge graphs, to produce new music-specific linguistic resources, and to publish and support curation of music contents.
Europe's Musical Heritage Knowledge (MHK) is kept in many places, but they are disconnected (no links) and heterogeneous (sound, texts, scores, all variously transmitted). Scholars, memory institutions, music professionals and artists, and citizens struggle to access and retrieve MHK. Even when they can access and explore it, it is hard to identify relations across music objects, or between MHK and historical or social events.
Polifonia is concerned with explicitly and homogeneously representing MHK, with dense interlinking and public access.
Polifonia has collected stories and use cases that hint at the need for methods and tools for (1) representing orally transmitted heritage and guaranteeing its preservation and transmission, 2) studying large and distributed digital collections of music objects and plurilingual texts, 3) discovering and representing MHK, its links to tangible cultural objects, and to their social, cultural, historical contexts, spanning several centuries and geographic areas.
Polifonia is building an ecosystem of computational methods and tools supporting discovery, extraction, encoding, interlinking, classification, exploration of, and access to, musical heritage knowledge on the Web.
Polifonia releases open source resources, methods, and software, performs dissemination actions for stakeholders and early adopters; increases the engagement of female students in STEM topics through MH-focused laboratories; supports reproducible and customisable artistic digital installation leveraging its technologies and resources; applies its results to ten pilots about preservation, management, studying and interaction with MHK, involving cultural institutes and collection owners, historians of music, anthropologists and ethnomusicologists, linguists, etc.
Europe's Musical Heritage Knowledge (MHK) is kept in many places, but they are disconnected (no links) and heterogeneous (sound, texts, scores, all variously transmitted). Scholars, memory institutions, music professionals and artists, and citizens struggle to access and retrieve MHK. Even when they can access and explore it, it is hard to identify relations across music objects, or between MHK and historical or social events.
Polifonia is concerned with explicitly and homogeneously representing MHK, with dense interlinking and public access.
Polifonia has collected stories and use cases that hint at the need for methods and tools for (1) representing orally transmitted heritage and guaranteeing its preservation and transmission, 2) studying large and distributed digital collections of music objects and plurilingual texts, 3) discovering and representing MHK, its links to tangible cultural objects, and to their social, cultural, historical contexts, spanning several centuries and geographic areas.
Polifonia is building an ecosystem of computational methods and tools supporting discovery, extraction, encoding, interlinking, classification, exploration of, and access to, musical heritage knowledge on the Web.
Polifonia releases open source resources, methods, and software, performs dissemination actions for stakeholders and early adopters; increases the engagement of female students in STEM topics through MH-focused laboratories; supports reproducible and customisable artistic digital installation leveraging its technologies and resources; applies its results to ten pilots about preservation, management, studying and interaction with MHK, involving cultural institutes and collection owners, historians of music, anthropologists and ethnomusicologists, linguists, etc.
# Website: https://polifonia-project.eu/(odnośnik otworzy się w nowym oknie)
# Ecosystem: https://polifonia-project.github.io/ecosystem/(odnośnik otworzy się w nowym oknie)
# Visual system: https://vimeo.com/518636055(odnośnik otworzy się w nowym oknie)
# GitHub repository: https://github.com/polifonia-project(odnośnik otworzy się w nowym oknie)
# RuleBook for developers: https://github.com/polifonia-project/rulebook(odnośnik otworzy się w nowym oknie)
# CLEF (Crowdsourcing Linked Entities via web Form): https://github.com/polifonia-project/registry_app(odnośnik otworzy się w nowym oknie)
# All pilots went through co-design with experts and first validation round
# Polifonia Ontology Network (PON): addresses the representation of music objects and their context: https://github.com/polifonia-project/ontology-network(odnośnik otworzy się w nowym oknie)
# SPARQL Anything extensions: from collections into RDF knowledge graphs: https://github.com/SPARQL-Anything/sparql.anything(odnośnik otworzy się w nowym oknie)
# Smashub (under testing): a software framework supporting the conversion of music datasets into knowledge graphs, complying with MIR standards https://github.com/smashub(odnośnik otworzy się w nowym oknie)
# Knowledge graphs: 11 knowledge graphs released (see the Ecosystem or the output page on the polifonia website)
# The Ceol Rince na hÉireann (CRE) reengineered to correct MIDI version: https://zenodo.org/record/5768216#.YhtsRpPMI-R(odnośnik otworzy się w nowym oknie)
# MIDI to LOD: https://github.com/midi-ld/midi2vec(odnośnik otworzy się w nowym oknie)
# Music objects analysis and patterns:
## Folk ngrams analysis (FONN) tools: https://zenodo.org/record/5768216#.YbEAbS2Q3T8(odnośnik otworzy się w nowym oknie)
## Local harmonic agreement based on recurrent patterns (LHARP): https://github.com/polifonia-project/lharp(odnośnik otworzy się w nowym oknie)
## abstract tree-based model to index music content - faceted search engine deployed for NEUMA: http://neuma.huma-num.fr/(odnośnik otworzy się w nowym oknie)
## ChoCo (Chord Corpus and knowledge graph - 20k tracks with curated chord annotations): https://github.com/smashub/choco(odnośnik otworzy się w nowym oknie)
# Software for text corpus population and OCR software: https://github.com/polifonia-project/textual-corpus-population(odnośnik otworzy się w nowym oknie)
# Specialised lexicon for MH (~4000 concepts): https://github.com/polifonia-project/Polifonia-Lexicon(odnośnik otworzy się w nowym oknie)
# Plurilingual text corpus (~250000 texts)
# Interacting with MH objects and knowledge:
## 2 workshops experimenting Haptic devices for supporting the ACCESS pilot
## Interface for multimodal music interpretation used in a live museum exhibition
## A thorough study on existing user interaction practices has been developed to design (and implement) an interactive tool supporting the exploration of music data and knowledge, in association with listening experiences
# Stakeholder network: 40 members and collaboration with many of them
# First stakeholder workshop held in Paris, September 2022 (25 external participants)
# Workshop on Multisensory Data & Knowledge at The Web Conference - collaboration between Polifonia and Odeuropa consortia: https://odeuropa.github.io/mdk/(odnośnik otworzy się w nowym oknie)
# Active participation at DARIAH Working Group AIM
# Polifonia keynotes: Copernicus Festival 2022, Podiumkunst 2022, SmartComp 2023, ICAART 2023
## Polifonia keynote and research demo at AI&Music - Sonar festival Barcelona (2021): https://polifonia-project.eu/re-watch-polifonia-presentation-at-ai-music-festival-sonar/(odnośnik otworzy się w nowym oknie)
#Some demos:
## FACETS (search and indexing engine for music scores): http://neuma-dev.huma-num.fr/(odnośnik otworzy się w nowym oknie)
## Tonalities (music annotation tools - score annotations based on music theories): https://data-iremus.huma-num.fr/tonalities/(odnośnik otworzy się w nowym oknie)
## Textual corpus interrogation tool: https://polifonia.disi.unibo.it/corpus/(odnośnik otworzy się w nowym oknie)
## Melody (creating datastories from knowledge graphs): https://projects.dharc.unibo.it/melody/(odnośnik otworzy się w nowym oknie)
## From text to knowledge graphs: https://arco.istc.cnr.it/txt-amr-fred/(odnośnik otworzy się w nowym oknie)
## musoW, browsing and querying more than 500 MH resources: https://w3id.org/musow/(odnośnik otworzy się w nowym oknie)
## Sonar interface design and demo - interaction combining listening experience with exploration of musical content and Knowledge: https://polifonia-project.github.io/sonar2021_demo/home(odnośnik otworzy się w nowym oknie)
## Musilar, interactive interface for browsing and querying harmonic similarity graphs: https://polifonia-project.github.io/musilar-preview/(odnośnik otworzy się w nowym oknie)
## ODP Reactor, knowledge graph visualisation based on ontology design patterns: https://github.com/ccolonna/odp-reactor/projects(odnośnik otworzy się w nowym oknie)
## Play italian bells' real sound: https://bellspilot.fly.dev/(odnośnik otworzy się w nowym oknie)
## CLEF (Crowdsourcing Linked Entities via web Form) https://polifonia-project.github.io/clef/(odnośnik otworzy się w nowym oknie)
# Ecosystem: https://polifonia-project.github.io/ecosystem/(odnośnik otworzy się w nowym oknie)
# Visual system: https://vimeo.com/518636055(odnośnik otworzy się w nowym oknie)
# GitHub repository: https://github.com/polifonia-project(odnośnik otworzy się w nowym oknie)
# RuleBook for developers: https://github.com/polifonia-project/rulebook(odnośnik otworzy się w nowym oknie)
# CLEF (Crowdsourcing Linked Entities via web Form): https://github.com/polifonia-project/registry_app(odnośnik otworzy się w nowym oknie)
# All pilots went through co-design with experts and first validation round
# Polifonia Ontology Network (PON): addresses the representation of music objects and their context: https://github.com/polifonia-project/ontology-network(odnośnik otworzy się w nowym oknie)
# SPARQL Anything extensions: from collections into RDF knowledge graphs: https://github.com/SPARQL-Anything/sparql.anything(odnośnik otworzy się w nowym oknie)
# Smashub (under testing): a software framework supporting the conversion of music datasets into knowledge graphs, complying with MIR standards https://github.com/smashub(odnośnik otworzy się w nowym oknie)
# Knowledge graphs: 11 knowledge graphs released (see the Ecosystem or the output page on the polifonia website)
# The Ceol Rince na hÉireann (CRE) reengineered to correct MIDI version: https://zenodo.org/record/5768216#.YhtsRpPMI-R(odnośnik otworzy się w nowym oknie)
# MIDI to LOD: https://github.com/midi-ld/midi2vec(odnośnik otworzy się w nowym oknie)
# Music objects analysis and patterns:
## Folk ngrams analysis (FONN) tools: https://zenodo.org/record/5768216#.YbEAbS2Q3T8(odnośnik otworzy się w nowym oknie)
## Local harmonic agreement based on recurrent patterns (LHARP): https://github.com/polifonia-project/lharp(odnośnik otworzy się w nowym oknie)
## abstract tree-based model to index music content - faceted search engine deployed for NEUMA: http://neuma.huma-num.fr/(odnośnik otworzy się w nowym oknie)
## ChoCo (Chord Corpus and knowledge graph - 20k tracks with curated chord annotations): https://github.com/smashub/choco(odnośnik otworzy się w nowym oknie)
# Software for text corpus population and OCR software: https://github.com/polifonia-project/textual-corpus-population(odnośnik otworzy się w nowym oknie)
# Specialised lexicon for MH (~4000 concepts): https://github.com/polifonia-project/Polifonia-Lexicon(odnośnik otworzy się w nowym oknie)
# Plurilingual text corpus (~250000 texts)
# Interacting with MH objects and knowledge:
## 2 workshops experimenting Haptic devices for supporting the ACCESS pilot
## Interface for multimodal music interpretation used in a live museum exhibition
## A thorough study on existing user interaction practices has been developed to design (and implement) an interactive tool supporting the exploration of music data and knowledge, in association with listening experiences
# Stakeholder network: 40 members and collaboration with many of them
# First stakeholder workshop held in Paris, September 2022 (25 external participants)
# Workshop on Multisensory Data & Knowledge at The Web Conference - collaboration between Polifonia and Odeuropa consortia: https://odeuropa.github.io/mdk/(odnośnik otworzy się w nowym oknie)
# Active participation at DARIAH Working Group AIM
# Polifonia keynotes: Copernicus Festival 2022, Podiumkunst 2022, SmartComp 2023, ICAART 2023
## Polifonia keynote and research demo at AI&Music - Sonar festival Barcelona (2021): https://polifonia-project.eu/re-watch-polifonia-presentation-at-ai-music-festival-sonar/(odnośnik otworzy się w nowym oknie)
#Some demos:
## FACETS (search and indexing engine for music scores): http://neuma-dev.huma-num.fr/(odnośnik otworzy się w nowym oknie)
## Tonalities (music annotation tools - score annotations based on music theories): https://data-iremus.huma-num.fr/tonalities/(odnośnik otworzy się w nowym oknie)
## Textual corpus interrogation tool: https://polifonia.disi.unibo.it/corpus/(odnośnik otworzy się w nowym oknie)
## Melody (creating datastories from knowledge graphs): https://projects.dharc.unibo.it/melody/(odnośnik otworzy się w nowym oknie)
## From text to knowledge graphs: https://arco.istc.cnr.it/txt-amr-fred/(odnośnik otworzy się w nowym oknie)
## musoW, browsing and querying more than 500 MH resources: https://w3id.org/musow/(odnośnik otworzy się w nowym oknie)
## Sonar interface design and demo - interaction combining listening experience with exploration of musical content and Knowledge: https://polifonia-project.github.io/sonar2021_demo/home(odnośnik otworzy się w nowym oknie)
## Musilar, interactive interface for browsing and querying harmonic similarity graphs: https://polifonia-project.github.io/musilar-preview/(odnośnik otworzy się w nowym oknie)
## ODP Reactor, knowledge graph visualisation based on ontology design patterns: https://github.com/ccolonna/odp-reactor/projects(odnośnik otworzy się w nowym oknie)
## Play italian bells' real sound: https://bellspilot.fly.dev/(odnośnik otworzy się w nowym oknie)
## CLEF (Crowdsourcing Linked Entities via web Form) https://polifonia-project.github.io/clef/(odnośnik otworzy się w nowym oknie)
Polifonia knowledge graphs and methods fosters advancement in music data interoperability and links between tangible and intangible entities (integration and extension of music notation ontologies; ontologies of multiple music contexts, including textual knowledge; associating notation patterns and contexts such as places, time, events; MHK copyright and provenance semantics).
Polifonia large-scale MHK analysis advances extraction of MHK patterns, applying them in the pilots, and supporting their use by stakeholders. That pattern layer is an asset for global exploration and discovery across MHK.
Polifonia advances large scale knowledge analysis of texts on musical heritage, discovering spatio-temporal data, agents, places, experiences, opinions, perceptions, cross-cultural perspectives.
Polifonia provides a web portal with a registry of resources, their provenance, a meta-search engine and other advanced query and exploration interfaces: visual, gestural, haptic.
Polifonia large-scale MHK analysis advances extraction of MHK patterns, applying them in the pilots, and supporting their use by stakeholders. That pattern layer is an asset for global exploration and discovery across MHK.
Polifonia advances large scale knowledge analysis of texts on musical heritage, discovering spatio-temporal data, agents, places, experiences, opinions, perceptions, cross-cultural perspectives.
Polifonia provides a web portal with a registry of resources, their provenance, a meta-search engine and other advanced query and exploration interfaces: visual, gestural, haptic.