Exploring Musical Possibilities via Machine Simulation

Informacje na temat projektu

Whither Music?

Identyfikator umowy o grant: 101019375

DOI

10.3030/101019375

Data podpisania przez KE 28 Kwietnia 2021

Data rozpoczęcia 1 Stycznia 2022

Data zakończenia 31 Grudnia 2027

Finansowanie w ramach

• EXCELLENT SCIENCE - European Research Council (ERC)

Koszt całkowity

€ 2 500 000,00

Wkład UE

€ 2 500 000,00

Koordynowany przez

UNIVERSITAT LINZ
Austria

CORDIS oferuje możliwość skorzystania z odnośników do publicznie dostępnych publikacji i rezultatów projektów realizowanych w ramach programów ramowych HORYZONT.

Odnośniki do rezultatów i publikacji związanych z poszczególnymi projektami 7PR, a także odnośniki do niektórych konkretnych kategorii wyników, takich jak zbiory danych i oprogramowanie, są dynamicznie pobierane z systemu OpenAIRE .

Publikacje

Conference proceedings (49)

Efficient Large-scale Audio Tagging via Transformer-to-CNN Knowledge Distillation

Autorzy: Florian Schmid, Khaled Koutini, Gerhard Widmer
Opublikowane w: IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2023, 2023
Wydawca: IEEE
DOI: 10.48550/arxiv.2211.04772

The match File Format: Encoding Alignments between Scores and Performances

Autorzy: Francesco Foscarin, Emmanouil Karystinaios, Silvan David Peter, Carlos Cancino-Chacón, Maarten Grachten, Gerhard Widmer
Opublikowane w: Proceedings of the Music Encoding Conference (MEC 2022), 2022
Wydawca: Tne Music Encoding Initiative (MEI)
DOI: 10.48550/arxiv.2206.01104

8+8=4: Formalizing Time Units to Handle Symbolic Music Durations

Autorzy: Emmanouil Karystinaios, Francesco Foscarin, Florent Jacquemard, Masahiko Sakai, Satoshi Tojo, Gerhard Widmer
Opublikowane w: Proceedings of the 16th International Symposium on Computer Music Multidisciplinary Research (CMMR 2023), 2023
Wydawca: Springer
DOI: 10.48550/arxiv.2310.14952

Cluster and Separate: A GNN Approach to Voice and Staff Prediction for Score Engraving

Autorzy: Francesco Foscarin, Emmanouil Karystinaios, Eita Nakamura, Gerhard Widmer
Opublikowane w: Proceedings of the 25th International Society for Music Information Retrieval Conference (ISMIR 2024), 2024
Wydawca: International Society for Music Information Retrieval
DOI: 10.48550/arxiv.2407.21030

The ACCompanion: Combining Reactivity, Robustness, and Musical Expressivity in an Automatic Piano Accompanist

Autorzy: Carlos Cancino-Chacón, Silvan Peter, Patricia Hu, Emmanouil Karystinaios, Florian Henkel, Francesco Foscarin, Nimrod Varga, Gerhard Widmer
Opublikowane w: Proceedings of the 32nd International Joint Conference on Artificial Intelligence (IJCAI-23), 2023
Wydawca: IJCAI
DOI: 10.48550/arxiv.2304.12939

EngravingGNN: A Hybrid Graph Neural Network for End-to-End Piano Score Engraving

Autorzy: Emmanouil Karystinaios, Francesco Foscarin, Gerhard Widmer
Opublikowane w: Proceedings of the International Conference on Technologies for Music Notation and Representation (TENOR), 2025
Wydawca: Central Conservatory of Music Beijing
DOI: 10.48550/arxiv.2509.19412

Are we describing the same sound? An Analysis of Word Embedding Spaces of Expressive Piano Performance

Autorzy: Silvan Peter, Shreyan Chowdhury, Carlos Cancino-Chacón, Gerhard Widmer
Opublikowane w: Proceedings of the Forum for Information Retrieval Evaluation (FIRE 2023), 2023
Wydawca: Association for Computing Machinery (ACM)
DOI: 10.1145/3632754.3632759

Passage Summarization with Recurrent Models for Audio-Sheet Music Retrieval

Autorzy: Luis Carvalho, Gerhard Widmer
Opublikowane w: Proceedings of the 24th Conference of the International Society for Music Information Retrieval (ISMIR 2023), 2023
Wydawca: International Society for Music Information Retrieval
DOI: 10.48550/arxiv.2309.12111

Music Boomerang: Reusing Diffusion Models for Data Augmentation and Audio Manipulation

Autorzy: Alexander Fichtinger, Jan Schlüter, Gerhard Widmer
Opublikowane w: Proceedings of the 22nd Sound and Music Computing Conference (SMC 2025), 2025
Wydawca: Sound and Music Computing Initiative
DOI: 10.48550/arxiv.2507.04864

The GlueNote: Learned Representations for Robust and Flexible Note Alignment

Autorzy: Silvan Peter, Gerhard Widmer
Opublikowane w: Proceedings of the 25th International Society for Music Information Retrieval Conference (ISMIR 2024), 2024
Wydawca: International Society for Music Information Retrieval
DOI: 10.48550/arxiv.2408.04309

Are Inherently Interpretable Models More Robust? A Study in Music Emotion Recognition

Autorzy: Katharina Hoedt, Arthur Flexer, Gerhard Widmer
Opublikowane w: Proceedings of the 22nd Sound and Music Computing Conference (SMC 2025), 2025
Wydawca: Sound and Music Computing Initiative
DOI: 10.5281/zenodo.15837274

Partitura: A Python Package for Symbolic Music Processing

Autorzy: Carlos Cancino-Chacón, Silvan David Peter, Emmanouil Karystinaios, Francesco Foscarin, Maarten Grachten, Gerhard Widmer
Opublikowane w: Proceedings of the Music Encoding Conference (MEC 2022), 2022
Wydawca: The Music Encoding Initiative (MEI)
DOI: 10.48550/arxiv.2206.01071

Estimating Musical Surprisal from Audio in Autoregressive Diffusion Model Noise Spaces

Autorzy: Mathias Rose Bjare, Stefan Lattner, Gerhard Widmer
Opublikowane w: Proceedings of the 26th International Society for Music Information Retrieval Conference (ISMIR), 2025
Wydawca: International Society for Music Information Retrieval
DOI: 10.48550/arxiv.2508.05306

The Rach3 Dataset: Towards Data-Driven Analysis of Piano Performance Rehearsal

Autorzy: Carlos Cancino-Chacón, Ivan Pilkov
Opublikowane w: Proceedings of the 30th International Conference on Multimedia Modeling (MMM 2024), 2024
Wydawca: Springer Verlag
DOI: 10.1007/978-3-031-56435-2_3

Decoding and Visualising Intended Emotion in an Expressive Piano Performance

Autorzy: Shreyan Chowdhury, Gerhard Widmer
Opublikowane w: 23rd International Society for Music Information Retrieval Conference (ISMIR 2022), Late-Breaking/Demo Papers, 2022
Wydawca: International Society for Music Information Retrieval (ISMIR)
DOI: 10.48550/arxiv.2303.01875

Beat this: Accurate Beat Tracking Without DBN Postprocessing

Autorzy: Francesco Foscarin, Jan Schlüter, Gerhard Widmer
Opublikowane w: Proceedings of the 25th International Society for Music Information Retrieval Conference (ISMIR 2024), 2024
Wydawca: International Society for Music Information Retrieval
DOI: 10.48550/arxiv.2407.21658

AnalysisGNN: Unified Music Analysis with Graph Neural Networks

Autorzy: Emmanouil Karystinaios, Johannes Hentschel, Markus Neuwirth, Gerhard Widmer
Opublikowane w: 17th International Symposium on Computer Music Multidisciplinary Research (CMMR), 2025
Wydawca: University College London
DOI: 10.48550/arxiv.2509.06654

Sounding Out Reconstruction Error-Based Evaluation of Generative Models of Expressive Performance

Autorzy: Silvan Peter, Carlos Cancino-Chacón, Emmanouil Karystinaios, Gerhard Widmer
Opublikowane w: Proceedings of the 10th International Conference on Digital Libraries for Musicology (DLfM '23), 2023, Strona(/y) 58-66
Wydawca: ACM
DOI: 10.1145/3625135.3625141

Discrete Diffusion Probabilistic Models for Symbolic Music Generation

Autorzy: Matthias Plasser, Silvan Peter, Gerhard Widmer
Opublikowane w: Proceedings of the 32nd International Joint Conference on Artificial Intelligence (IJCAI-23), 2023
Wydawca: IJCAI

Exploring System Adaptations For Minimum Latency Real-Time Piano Transcription

Autorzy: Patricia Hu, Silvan David Peter, Jan Schlüter, Gerhard Widmer
Opublikowane w: Proceedings of the 26th International Society for Music Information Retrieval Conference (ISMIR 2025), 2025
Wydawca: International Society for Music Information Retrieval
DOI: 10.48550/arxiv.2509.07586

The Batik-plays-Mozart Corpus: Linking Performance to Score to Musicological Annotations

Autorzy: Patricia Hu, Gerhard Widmer
Opublikowane w: Proceedings of the 24th International Society for Music Information Retrieval Conference (ISMIR 2023), 2023
Wydawca: International Society for Music Information Retrieval
DOI: 10.48550/arxiv.2309.02399

"Concept-Based Techniques for ""Musicologist-friendly"" Explanations in a Deep Music Classifier"

Autorzy: Francesco Foscarin, Katharina Hoedt, Verena Praher, Arthur Flexer, Gerhard Widmer
Opublikowane w: Proceedings of the 23rd International Society for Music Information Retrieval Conference (ISMIR 2022), 2022
Wydawca: International Society for Music Information Retrieval
DOI: 10.48550/arxiv.2208.12485

Estimating Musical Surprisal in Audio

Autorzy: Mathias Rose Bjare, Giorgia Cantisani, Stefan Lattner, Gerhard Widmer
Opublikowane w: Proceedings of the 2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2025), 2025
Wydawca: IEEE
DOI: 10.48550/arxiv.2501.07474

Exploring Sampling Techniques for Generating Melodies with a Transformer Language Model

Autorzy: Mathias Rose Bjare, Stefan Lattner, Gerhard Widmer
Opublikowane w: Proceedings of the 24th International Society for Music Information Retrieval Conference (ISMIR 2023), 2023
Wydawca: International Society for Music Information Retrieval
DOI: 10.48550/arxiv.2308.09454

Perception-Inspired Graph Convolution for Music Understanding Tasks

Autorzy: Emmanouil Karystinaios, Francesco Foscarin, Gerhard Widmer
Opublikowane w: Proceedings of the 33rd International Joint Conference on Artificial Intelligence (IJCAI-24), 2024
Wydawca: International Joint Conferences on Artificial Intelligence, Inc. (IJCAI)
DOI: 10.48550/arxiv.2405.09224

Cadence Detection in Symbolic Classical Music using Graph Neural Networks

Autorzy: Emmanouil Karystinaios and Gerhard Widmer
Opublikowane w: Proceedings of the 23rd International Society for Music Information Retrieval Conference (ISMIR 2022), 2022
Wydawca: International Society for Music Information Retrieval
DOI: 10.48550/arxiv.2208.14819

Towards Robust and Truly Large-Scale Audio-Sheet Music Retrieval

Autorzy: Luis Carvalho, Gerhard Widmer
Opublikowane w: Proceedings of the IEEE 6th International Conference on Multimedia Information Processing and Retrieval (MIPR), 2023
Wydawca: IEEE
DOI: 10.48550/arxiv.2309.12158

SMUG-Explain: A Framework for Symbolic Music Graph Explanations

Autorzy: Emmanouil Karystinaios, Francesco Foscarin, Gerhard Widmer
Opublikowane w: Proceedings of the Sound and Music Computing Conference 2024 (SMC2024), 2024
Wydawca: Sound and Music Computing Network
DOI: 10.48550/arxiv.2405.09241

Predicting Music Hierarchies with a Graph-Based Neural Decoder

Autorzy: Francesco Foscarin, Daniel Harasim, Gerhard Widmer
Opublikowane w: Proceedings of the 24th International Society for Music Information Retrieval Conference (ISMIR 2023), 2023
Wydawca: International Society for Music Information Retrieval
DOI: 10.48550/arxiv.2306.16955

Self-Supervised Contrastive Learning for Robust Audio-Sheet Music Retrieval Systems

Autorzy: Luis Carvalho, Tobias Washüttl, Gerhard Widmer
Opublikowane w: Proceedings of the 14th ACM Conference on Multimedia Systems (MMSys 2023), 2023
Wydawca: Association for Computing Machinery (ACM)
DOI: 10.1145/3587819.3590968

How to Infer Repeat Structures in MIDI Performances

Autorzy: Silvan Peter, Patricia Hu, Gerhard Widmer
Opublikowane w: Proceedings of the Music Encoding Conference (MEC 2025), 2025
Wydawca: Music Encoding Initiative
DOI: 10.48550/arxiv.2505.05055

Differentiable Dictionary Search: Integrating Linear Mixing with Deep Non-Linear Modelling for Audio Source Separation

Autorzy: Lukas Samuel Martak, Rainer Kelz, Gerhard Widmer
Opublikowane w: Proceedings of the 24th International Congress on Acoustics (ICA 2022), 2022
Wydawca: International Commission for Acoustics (ICA)

Defending a Music Recommender Against Hubness-Based Adversarial Attacks

Autorzy: Katharina Hoedt, Arthur Flexer, Gerhard Widmer
Opublikowane w: Proceedings of the 19th Sound and Music Computing Conference (SMC 2022), 2022
Wydawca: Telecom Saint-Etienne
DOI: 10.5281/zenodo.6573391

Symbolic Music Representations for Classification Tasks: A Systematic Evaluation

Autorzy: Huan Zhang, Emmanouil Karystinaios, Simon Dixon, Gerhard Widmer, Carlos Eduardo Cancino-Chacón
Opublikowane w: Proceedings of the 24th International Society for Music Information Retrieval Conference (ISMIR 2023), 2023
Wydawca: International Society for Music Information Retrieval
DOI: 10.48550/arxiv.2309.02567

GraphMuse: A Library for Symbolic Music Graph Processing

Autorzy: Emmanouil Karystinaios, Gerhard Widmer
Opublikowane w: Proceedings of the 25th International Society for Music Information Retrieval Conference (ISMIR 2024), 2024
Wydawca: International Society for Music Information Retrieval
DOI: 10.48550/arxiv.2407.12671

Pairing Real-Time Piano Transcription with Symbol-level Tracking for Precise and Robust Score Following

Autorzy: Silvan Peter, Patricia Hu, Gerhard Widmer
Opublikowane w: Proceedings of the 22nd Sound and Music Computing Conference (SMC 2025), 2025
Wydawca: Sound and Music Computing Initiative
DOI: 10.48550/arxiv.2505.05078

Optical Music Recognition of Jazz Lead Sheets

Autorzy: Juan Carlos Martinez-Sevilla, Francesco Foscarin, Patricia Garcia-Iasci, David Rizo, Jorge Calvo-Zaragoza, Gerhard Widmer
Opublikowane w: Proceedings of the 26th International Society for Music Information Retrieval Conference (ISMIR 2025), 2025
Wydawca: International Society for Music Information Retrieval
DOI: 10.48550/arxiv.2509.05329

Towards Musically Informed Evaluation of Piano Transcription Models

Autorzy: Patricia Hu, Lukas Martak, Carlos Cancino-Chacon, Gerhard Widmer
Opublikowane w: Proceedings of the 25th International Society for Music Information Retrieval Conference (ISMIR 2024), 2024
Wydawca: International Society for Music Information Retrieval
DOI: 10.48550/arxiv.2406.08454

Exploring Performance-Complexity Trade-Offs in Sound Event Detection Models

Autorzy: Tobias Morocutti, Florian Schmid, Jonathan Greif, Francesco Foscarin, Gerhard Widmer
Opublikowane w: Proceedings of the 33rd European Signal Processing Conference (EUSIPCO 2025), 2025
Wydawca: IEEE
DOI: 10.48550/arxiv.2503.11373

Online Symbolic Music Alignment with Offline Reinforcement Learning

Autorzy: Silvan Peter
Opublikowane w: Proceedings of the 24th International Society for Music Information Retrieval Conference (ISMIR 2023), 2023
Wydawca: International Society for Music Information Retrieval
DOI: 10.48550/arxiv.2401.00466

Controlling Surprisal in Music Generation via Information Content Curve Matching

Autorzy: Mathias Bjare, Stefan Lattner, Gerhard Widmer
Opublikowane w: Proceedings of the 25th International Society for Music Information Retrieval Conference (ISMIR 2024), 2023
Wydawca: International Society for Music Information Retrieval
DOI: 10.48550/arxiv.2408.06022

Learning General Audio Representations with Large-Scale Training of Patchout Audio Transformers

Autorzy: Khaled Koutini, Shahed Masoudian, Florian Schmid, Hamid Eghbal-zadeh, Jan Schlüter, Gerhard Widmer
Opublikowane w: Proceedings of HEAR 2021: Holistic Evaluation of Audio Representations, 2022, Strona(/y) PMLR 166, 65-89, ISSN 2640-3498
Wydawca: JMLR, Inc.
DOI: 10.48550/arxiv.2211.13956

Music Visualisation and Its Short-Term Effect on Appraisal Skills

Autorzy: Ali Nikrang, Maarten Grachten, Martin Gasser, Harald Frostel, Gerhard Widmer, Tom Collins
Opublikowane w: HCI International 2023 – Late Breaking Papers. HCII 2023, 2023
Wydawca: Springer
DOI: 10.1007/978-3-031-48044-7_9

Musical Voice Separation as Link Prediction: Modeling a Musical Perception Task as a Multi-Trajectory Tracking Problem

Autorzy: Emmanouil Karystinaios, Francesco Foscarin, Gerhard Widmer
Opublikowane w: Proceedings of the 32nd International Joint Conference on Artificial Intelligence (IJCAI 2023), 2023
Wydawca: IJCAI

Roman Numeral Analysis with Graph Neural Networks: Onset-wise Predictions from Note-wise Features

Autorzy: Emmanouil Karystinaios, Gerhard Widmer
Opublikowane w: Proceedings of the 24th International Society for Music Information Retrieval Conference (ISMIR 2023), 2023
Wydawca: International Society for Music Information Retrieval
DOI: 10.48550/arxiv.2307.03544

Language Models for Music Medicine Generation

Autorzy: Emmanouil Nikolakakis, Joann Ching, Emmanouil Karystinaios, Gabrielle Sipin, Gerhard Widmer, Razvan Marinescu
Opublikowane w: Extended Abstracts, Late-Breaking Demo Session, 25th International Society for Music Information Retrieval Conference (ISMIR 2024),, 2024
Wydawca: International Society for Music Information Retrieval
DOI: 10.48550/arxiv.2411.09080

Quantifying the Corpus Bias Problem in Automatic Music Transcription Systems

Autorzy: Lukas Samuel Martak, Patricia Hu, Gerhard Widmer
Opublikowane w: 1st International Workshop on Sound Signal Processing Applications (IWSSPA), 2024
Wydawca: CMMSE
DOI: 10.48550/arxiv.2408.04737

Concept-based Explanations for Music Emotion Recognition

Autorzy: Verena Praher, Verena Szojak, Gerhard Widmer
Opublikowane w: Proceedings of the 22nd Sound and Music Computing Conference (SMC 2025), 2025
Wydawca: Sound and Music Computing Initiative
DOI: 10.5281/zenodo.15837275

Expressivity-aware Music Performance Retrieval using Mid-level Perceptual Features and Emotion Word Embeddings

Autorzy: Shreyan Chowdhury, Gerhard Widmer
Opublikowane w: Proceedings of the Forum for Information Retrieval Evaluation Conference /(FIRE 2023), 2023
Wydawca: ACM

Peer reviewed articles (7)

Commentary on “A Computational Approach to the Detection and Prediction of (Ir)Regularity in Children’s Folk Songs”

Autorzy: Carlos Cancino-Chacón
Opublikowane w: Empirical Musicology Review, Numer 16(2), 2023, Strona(/y) 328-335, ISSN 1559-5749
Wydawca: The Ohio State University Libraries
DOI: 10.18061/emr.v16i2.9159

Differentiable Short-Term Models for Efficient Online Learning and Prediction in Monophonic Music

Autorzy: Mathias Rose Bjare, Stefan Lattner, Gerhard Widmer
Opublikowane w: Transactions of the International Society for Music Information Retrieval, Numer 5(1), 2022, Strona(/y) 190-207, ISSN 2514-3298
Wydawca: Ubiquity Press
DOI: 10.5334/tismir.123

Automatic Note-Level Score-to- Performance Alignments in the ASAP Dataset

Autorzy: Silvan Peter, Carlos Eduardo Cancino-Chacón, Francesco Foscarin, Andrew P. McLeod, Florian Henkel, Emmanouil Karystinaios, Gerhard Widmer
Opublikowane w: Transactions of the International Society for Music Information Retrieval, Numer 6(1), 2023, Strona(/y) 27–42, ISSN 2514-3298
Wydawca: Ubiquity Press
DOI: 10.5334/tismir.149

Balancing Bias and Performance in Polyphonic Piano Transcription Systems

Autorzy: Lukas Samuel Martak, Rainer Kelz, Gerhard Widmer
Opublikowane w: Frontiers in Signal Processing, Numer 2:975932, 2022, ISSN 2673-8198
Wydawca: Frontiers Media SA
DOI: 10.3389/frsip.2022.975932

DExter: Learning and Controlling Performance Expression with Diffusion Models

Autorzy: Huan Zhang, Shreyan Chowdhury, Carlos Eduardo Cancino-Chacón, Jinhua Liang, Simon Dixon, Gerhard Widmer
Opublikowane w: Applied Sciences, Numer 14(15), 2024, Strona(/y) 1-17, ISSN 2076-3417
Wydawca: MDPI
DOI: 10.3390/app14156543

Dynamic Convolutional Neural Networks as Efficient Pre-Trained Audio Models

Autorzy: Florian Schmid, Khaled Koutini, Gerhard Widmer
Opublikowane w: IEEE/ACM Transactions on Audio, Speech, and Language Processing, 2024, ISSN 2329-9290
Wydawca: IEEE Advancing Technology for Humanity
DOI: 10.1109/taslp.2024.3376984

Constructing Adversarial Examples to Investigate the Plausibility of Explanations in Deep Audio and Image Classifiers

Autorzy: Katharina Hoedt, Verena Praher, Arthur Flexer, Gerhard Widmer
Opublikowane w: Neural Computing and Applications, Numer 2022, 2022, ISSN 0941-0643
Wydawca: Springer Verlag
DOI: 10.1007/s00521-022-07918-7

Thesis and dissertations (7)

The Human Performance: Computational Methods for the Analysis of Played Classical Piano Music

Autorzy: Silvan Peter
Opublikowane w: 2025
Wydawca: Johannes Kepler University Linz

Symbolic Music Generation using Discrete Diffusion Probabilistic Models

Autorzy: Matthias Plasser
Opublikowane w: Master Thesis, 2023
Wydawca: Johannes Kepler University Linz (JKU)

(de)Fusion of Score and Performance Representations for Symbolic Music Generation

Autorzy: Tara Jadidi
Opublikowane w: Master Thesis, 2024
Wydawca: Johannes Kepler University (JKU)

Multi-modal Deep Learning for On-line Music Following in Score Sheet Images

Autorzy: Florian Henkel
Opublikowane w: PhD Thesis, 2022
Wydawca: Johannes Kepler University Linz

Multi-modal Music Search and Retrieval Without Symbolic Representations

Autorzy: Luis Carvalho
Opublikowane w: PhD Thesis, 2025
Wydawca: Johannes Kepler University

Modelling Emotional Expression in Music Using Interpretable and Transferable Perceptual Features

Autorzy: Shreyan Chowdhury
Opublikowane w: PhD Thesis, 2022
Wydawca: Johannes Kepler University Linz

Symbolic Music Analysis with Graph Neural Networks

Autorzy: Emmanouil Karystinaios
Opublikowane w: Ph.D. Thesis, 2024
Wydawca: Johannes Kepler University (JKU)