Technology Enhanced Learning of Musical Instrument Performance

Informacje na temat projektu

TELMI

Identyfikator umowy o grant: 688269

DOI

10.3030/688269

Projekt został zamknięty

Data podpisania przez KE 10 Listopada 2015

Data rozpoczęcia 1 Lutego 2016

Data zakończenia 31 Stycznia 2019

Finansowanie w ramach

• INDUSTRIAL LEADERSHIP - Leadership in enabling and industrial technologies - Information and Communication Technologies (ICT)

Koszt całkowity

€ 2 617 425,00

Wkład UE

€ 2 617 425,00

Koordynowany przez

UNIVERSIDAD POMPEU FABRA
Spain

CORDIS oferuje możliwość skorzystania z odnośników do publicznie dostępnych publikacji i rezultatów projektów realizowanych w ramach programów ramowych HORYZONT.

Odnośniki do rezultatów i publikacji związanych z poszczególnymi projektami 7PR, a także odnośniki do niektórych konkretnych kategorii wyników, takich jak zbiory danych i oprogramowanie, są dynamicznie pobierane z systemu OpenAIRE .

Rezultaty

Demonstrators, pilots, prototypes (8)

First version of TELMI System Platform
Second version of the data acquisition systems prototypes

Based on user feedback about usability and practical concerns during the recordings of the reference database as well as the student progress following, a second version of improved prototypes will be delivered.

RCM Event
Final version of TELMI System Platform
Final platforms of the data acquisition systems

The final prototypes of the measuring systems combining different modalities and fully integrated with the database, user interface and feedback systems.

First working prototypes of the measuring systems

The first working prototypes of the measuring system will be available to start recording violin masters for the reference database. This means that the database system from WP6-Integration should be available as well. Includes systems based on EMF sensors, IR Cameras, and Audio.

Public Database

This deliverable will contain the details about the setup of a public multimodal database of musical performances available for consultation and research. This multimodal recordings‘ database will allow to browse the multimodal recordings using a powerful html5 web based visualizer as well as allow the users to download the recordings for their research analysis. This database will include all data gathered during the recordings done during the whole project.

Final public event

Websites, patent fillings, videos etc. (2)

Start-up public event
Website of the Project

Website of the Project (first public version Month 6 and regular updates)

Open Research Data Pilot (1)

Data Management Plan

Documents, reports (2)

Final feature definition and computation algorithms
User-evaluations of each technology in each scenario completed

Publikacje

Peer reviewed articles (12)

Machine learning and music generation

Autorzy: José M. Iñesta, Darrell Conklin, Rafael Ramírez
Opublikowane w: Journal of Mathematics and Music, Numer 10/2, 2016, Strona(/y) 87-91, ISSN 1745-9737
Wydawca: Taylor and Francis Ltd.
DOI: 10.1080/17459737.2016.1216369

EEG-Based Analysis of the Emotional Effect of Music Therapy on Palliative Care Cancer Patients

Autorzy: Rafael Ramirez, Josep Planas, Nuria Escude, Jordi Mercade, Cristina Farriols
Opublikowane w: Frontiers in Psychology, Numer 9, 2018, ISSN 1664-1078
Wydawca: Frontiers Research Foundation
DOI: 10.3389/fpsyg.2018.00254

Seeking reproducibility: Assessing a multimodal study of the testing effect

Autorzy: M. Beardsley, D. Hernández-Leo, R. Ramirez-Melendez
Opublikowane w: Journal of Computer Assisted Learning, Numer 34/4, 2018, Strona(/y) 378-386, ISSN 0266-4909
Wydawca: Blackwell Publishing Inc.
DOI: 10.1111/jcal.12265

Mapping between dynamic markings and performed loudness: a machine learning approach

Autorzy: Katerina Kosta, Rafael Ramírez, Oscar F. Bandtlow, Elaine Chew
Opublikowane w: Journal of Mathematics and Music, Numer 10/2, 2016, Strona(/y) 149-172, ISSN 1745-9737
Wydawca: Taylor and Francis Ltd.
DOI: 10.1080/17459737.2016.1193237

Evaluation of a Sound Quality Visual Feedback System for Bow Learning Technique in Violin Beginners: An EEG Study

Autorzy: Angel David Blanco, Rafael Ramirez
Opublikowane w: Frontiers in Psychology, Numer 10, 2019, ISSN 1664-1078
Wydawca: Frontiers Research Foundation
DOI: 10.3389/fpsyg.2019.00165

Automatic Assessment of Tone Quality in Violin Music Performance

Autorzy: Sergio Giraldo, George Waddell, Ignasi Nou, Ariadna Ortega, Oscar Mayor, Alfonso Perez, Aaron Williamon, Rafael Ramirez
Opublikowane w: Frontiers in Psychology, Numer 10, 2019, Strona(/y) 334, ISSN 1664-1078
Wydawca: Frontiers Research Foundation
DOI: 10.3389/fpsyg.2019.00334

Bowing Gestures Classification in Violin Performance: A Machine Learning Approach

Autorzy: David Dalmazzo, Rafael Ramírez
Opublikowane w: Frontiers in Psychology, Numer 10, 2019, ISSN 1664-1078
Wydawca: Frontiers Research Foundation
DOI: 10.3389/fpsyg.2019.00344

Analysis of Movement Quality in Full-Body Physical Activities

Autorzy: Radoslaw Niewiadomski, Ksenia Kolykhalova, Stefano Piana, Paolo Alborno, Gualtiero Volpe, Antonio Camurri
Opublikowane w: ACM Transactions on Interactive Intelligent Systems, Numer 9/1, 2019, Strona(/y) 1-20, ISSN 2160-6455
Wydawca: Association for Computing Machinery (ACM)
DOI: 10.1145/3132369

The EyeHarp: A Gaze-Controlled Digital Musical Instrument

Autorzy: Zacharias Vamvakousis, Rafael Ramirez
Opublikowane w: Frontiers in Psychology, Numer 7, 2016, ISSN 1664-1078
Wydawca: Frontiers Research Foundation
DOI: 10.3389/fpsyg.2016.00906

Enriched Multimodal Representations of Music Performances: Online Access and Visualization

Autorzy: Esteban Maestre, Panagiotis Papiotis, Marco Marchini, Quim Llimona, Oscar Mayor, Alfonso Perez, Marcelo M. Wanderley
Opublikowane w: IEEE MultiMedia, Numer 24/1, 2017, Strona(/y) 24-34, ISSN 1070-986X
Wydawca: Institute of Electrical and Electronics Engineers
DOI: 10.1109/MMUL.2017.3

A Machine Learning Approach to Discover Rules for Expressive Performance Actions in Jazz Guitar Music

Autorzy: Sergio I. Giraldo, Rafael Ramirez
Opublikowane w: Frontiers in Psychology, Numer 7, 2016, ISSN 1664-1078
Wydawca: Frontiers Research Foundation
DOI: 10.3389/fpsyg.2016.01965

A machine learning approach to ornamentation modeling and synthesis in jazz guitar

Autorzy: Sergio Giraldo, Rafael Ramírez
Opublikowane w: Journal of Mathematics and Music, Numer 10/2, 2016, Strona(/y) 107-126, ISSN 1745-9737
Wydawca: Taylor and Francis Ltd.
DOI: 10.1080/17459737.2016.1207814

Conference proceedings (27)

A computational approach for measuring performance quality in violin tones

Autorzy: Sergio Giraldo; Rafael Ramirez; George Waddell; Aaron Williamon
Opublikowane w: Abstracts of the International Symposium in Performance Science (ISPS 2017), Reijavik, Iceland., Numer 4, 2017
Wydawca: ISPS
DOI: 10.5281/zenodo.2579194

A realtime feedback learning tool to visualize sound quality in violin performances

Autorzy: Sergio Giraldo; Rafael Ramirez; George Waddell; Aaron Williamon
Opublikowane w: Numer 4, 2017
Wydawca: MML
DOI: 10.5281/zenodo.2580053

Computational modelling of timbre dimensions for automatic violin tone quality assessment

Autorzy: Sergio Giraldo; Rafael Ramirez; George Waddell; Aaron Williamon
Opublikowane w: Proceedings of the 2018 TIMBRE is a many splendored thing Conference, Montreal, Canada., Numer 2, 2018
Wydawca: McGill
DOI: 10.5281/zenodo.2579163

Enhancing Music Learning with Smart Technologies

Autorzy: Rafael Ramirez, Alfonso Perez, George Waddell, Aaron Williamon, Corrado Canepa, Simone Ghisio, Ksenia Kolykhalova, Maurizio Mancini, Erica Volta, Gualtiero Volpe, Sergio Giraldo, Oscar Mayor
Opublikowane w: Proceedings of the 5th International Conference on Movement and Computing - MOCO '18, 2018, Strona(/y) 1-4, ISBN 9781-450365048
Wydawca: ACM Press
DOI: 10.1145/3212721.3212886

Detection and Regression of Violin Vibrato from Scores and Mobile Devices Rendering for Didactic Purposes

Autorzy: Furkan Yesiler, Rafael Ramirez
Opublikowane w: Proceedings of the Sound and Music Computing Conference, 2018
Wydawca: SMC

Automatically measuring biomechanical skills of violin performance - an exploratory study

Autorzy: Erica Volta, Maurizio Mancini, Giovanna Varni, Gualtiero Volpe
Opublikowane w: Proceedings of the 5th International Conference on Movement and Computing - MOCO '18, 2018, Strona(/y) 1-4, ISBN 9781-450365048
Wydawca: ACM Press
DOI: 10.1145/3212721.3212840

Automatic assessment of violin performance using dynamic time warping classification

Autorzy: Sergio Giraldo, Ariadna Ortega, Alfonso Perez, Rafael Ramirez, George Waddell, Aaron Williamon
Opublikowane w: 2018 26th Signal Processing and Communications Applications Conference (SIU), 2018, Strona(/y) 1-3, ISBN 978-1-5386-1501-0
Wydawca: IEEE
DOI: 10.1109/SIU.2018.8404556

A Machine Learning Approach to Classification of Phonation Modes in Singing.

Autorzy: Matteo Lionello, Rafael Ramirez
Opublikowane w: 2018
Wydawca: SMC

Air violin: a machine learning approach to fingering gesture recognition

Autorzy: David Dalmazzo, Rafael Ramirez
Opublikowane w: Proceedings of the 1st ACM SIGCHI International Workshop on Multimodal Interaction for Education - MIE 2017, 2017, Strona(/y) 63-66, ISBN 9781-450355575
Wydawca: ACM Press
DOI: 10.1145/3139513.3139526

Neural Correlates of Bow Learning Technique

Autorzy: Angel David Blanco; Rafael Ramirez
Opublikowane w: 10th International Workshop on Machine Learning and Music, 2017
Wydawca: MML

Bowing modeling for violin students assistance

Autorzy: Fabio J. M. Ortega, Sergio I. Giraldo, Rafael Ramirez
Opublikowane w: Proceedings of the 1st ACM SIGCHI International Workshop on Multimodal Interaction for Education - MIE 2017, 2017, Strona(/y) 60-62, ISBN 9781-450355575
Wydawca: ACM Press
DOI: 10.1145/3139513.3139525

Acquisition of Violin Instrumental Gestures Using an Infrared Depth Camera

Autorzy: Zacharias Vamvakousis; Alfonso Perez Carrillo; Rafael Ramirez
Opublikowane w: Proceedings of the 15th Sound and Music Computing Conference (SMC2018), Limassol, Cyprus, 4-7 July, 2018
Wydawca: SMC
DOI: 10.5281/zenodo.1422548

Automated Analysis of Postural and Movement Qualities of Violin Players

Autorzy: Erica Volta, Gualtiero Volpe
Opublikowane w: 2019 International Workshop on Multilayer Music Representation and Processing (MMRP), 2019, Strona(/y) 56-59, ISBN 978-1-7281-1649-5
Wydawca: IEEE
DOI: 10.1109/mmrp.2019.8665374

Phrase-Level Modeling of Expression in Violin Performances

Autorzy: Fabio J. M. Ortega, Sergio I. Giraldo, Rafael Ramirez
Opublikowane w: 10th International Workshop on Machine Learning and Music, 2017
Wydawca: mml

A Machine Learning Approach to Violin Bow Technique Classification - a Comparison Between IMU and MOCAP systems

Autorzy: David Dalmazzo, Simone Tassani, Rafael Ramírez
Opublikowane w: Proceedings of the 5th international Workshop on Sensor-based Activity Recognition and Interaction - iWOAR '18, 2018, Strona(/y) 1-8, ISBN 9781450364874
Wydawca: ACM Press
DOI: 10.1145/3266157.3266216

Evaluation of audio-based feedback technologies for bow learning technique in violin beginners

Autorzy: Angel Blanco, Rafael Ramirez
Opublikowane w: Proceedings of the 1st ACM SIGCHI International Workshop on Multimodal Interaction for Education - MIE 2017, 2017, Strona(/y) 41-43, ISBN 9781-450355575
Wydawca: ACM Press
DOI: 10.1145/3139513.3139520

Estimation of violin bowing features from Audio recordings with Convolutional Networks

Autorzy: A. Perez-Carrillo, H. Purwins
Opublikowane w: Conference and Workshop on Neural Information Processing Systems (NIPS), 2017
Wydawca: Neural Information Processing Systems Foundation, Inc.

A multimodal corpus for technology-enhanced learning of violin playing

Autorzy: Gualtiero Volpe, Ksenia Kolykhalova, Erica Volta, Simone Ghisio, George Waddell, Paolo Alborno, Stefano Piana, Corrado Canepa, Rafael Ramirez-Melendez
Opublikowane w: Proceedings of the 12th Biannual Conference on Italian SIGCHI Chapter - CHItaly '17, 2017, Strona(/y) 1-5, ISBN 9781-450352376
Wydawca: ACM Press
DOI: 10.1145/3125571.3125588

Informing bowing and violin learning using movement analysis and machine learning

Autorzy: E. Volta, P. Alborno, and G. Volpe
Opublikowane w: Proceedings of the 10th International Workshop on Machine Learning and Music, 2017
Wydawca: MML
DOI: 10.13140/rg.2.2.24907.49443

Jazz ensemble expressive performance modeling

Autorzy: Bantula, Helena; Giraldo, Sergio Iván; Ramírez, Rafael,1966-
Opublikowane w: Numer 1, 2016
Wydawca: International Society for Music Information Retrieval (ISMIR)
DOI: 10.5281/zenodo.1415876

Exploiting multimodal integration in adaptive interactive systems and game-based learning interfaces

Autorzy: Erica Volta, Gualtiero Volpe
Opublikowane w: Proceedings of the 5th International Conference on Movement and Computing - MOCO '18, 2018, Strona(/y) 1-4, ISBN 9781-450365048
Wydawca: ACM Press
DOI: 10.1145/3212721.3212849

Acquisition of Human Body Kinematic and Dynamic Features in Violin Performances with Kinect

Autorzy: Pablo Fernandez Blanco, Alfonso Perez-Carrillo, Mario Ceresa
Opublikowane w: First International Workshop on Motor Learning For Music Performance, Numer 1, 2017, 2017
Wydawca: Aalborg University Copenhagen

Statistical models for the indirect acquisition of violin bowing controls from audio analysis

Autorzy: Alfonso Perez-Carrillo
Opublikowane w: Proceedings of Meetings on Acoustics, Numer 29, 2017, 2017, Strona(/y) 035003
Wydawca: Acoustical Society of America
DOI: 10.1121/2.0000402

ESTIMATION OF BOWING PARAMETERS IN VIOLIN PLAYING FROM AUDIO ANALYSIS

Autorzy: Alfonso Perez-Carrillo
Opublikowane w: Abstracts of the International Symposium on Performance Science 2017, Numer 1, 2017, 2017, Strona(/y) 192, ISBN 9789-935937803
Wydawca: Iceland Academy of the Arts

JAZZ ENSEMBLE EXPRESSIVE PERFORMANCE MODELING

Autorzy: Helena Bantula, Sergio Giraldo and Rafael Ramirez
Opublikowane w: 17th International Society for Music Information Retrieval Conference, 2016., Numer Ago 12, 2016, 2016
Wydawca: International Society for Music Information Retrieval

A Genetic Approach for Evaluation of Computational Models for Expressive Music Performance in Jazz Guitar

Autorzy: Sergio Giraldo and Rafael Ramirez
Opublikowane w: 9th International Workshop on Machine Learning, Numer September 23, 2016, 2016
Wydawca: MML

HEXAPHONIC GUITAR TRANSCRIPTION AND VISUALISATION

Autorzy: Iñigo Angulo Ortegui, Sergio Giraldo, Rafael Ramirez
Opublikowane w: Second International Conference on Technologies for Music Notation and Representation, Numer 27-29 May 2016, 2016
Wydawca: Anglia Ruskin University

Non-peer reviewed articles (1)

Musical neurofeedback for treating depression in elderly people

Autorzy: Rafael Ramirez, Manel Palencia-Lefler, Sergio Giraldo, Zacharias Vamvakousis
Opublikowane w: Frontiers in Neuroscience, Numer 9, 2015, ISSN 1662-453X
Wydawca: Frontiers
DOI: 10.3389/fnins.2015.00354

Book chapters (1)

Violin Timbre Navigator: Real-Time Visual Feedback of Violin Bowing Based on Audio Analysis and Machine Learning

Autorzy: Alfonso Perez-Carrillo
Opublikowane w: MultiMedia Modeling - 25th International Conference, MMM 2019, Thessaloniki, Greece, January 8–11, 2019, Proceedings, Part II, Numer 11296, 2019, Strona(/y) 182-193, ISBN 978-3-030-05715-2
Wydawca: Springer International Publishing
DOI: 10.1007/978-3-030-05716-9_15