Technology Enhanced Learning of Musical Instrument Performance

Deliverables

First version of TELMI System Platform
Second version of the data acquisition systems prototypes

Based on user feedback about usability and practical concerns during the recordings of the reference database as well as the student progress following, a second version of improved prototypes will be delivered.

RCM Event
Final version of TELMI System Platform
Final platforms of the data acquisition systems

The final prototypes of the measuring systems combining different modalities and fully integrated with the database, user interface and feedback systems.

First working prototypes of the measuring systems

The first working prototypes of the measuring system will be available to start recording violin masters for the reference database. This means that the database system from WP6-Integration should be available as well. Includes systems based on EMF sensors, IR Cameras, and Audio.

Public Database

This deliverable will contain the details about the setup of a public multimodal database of musical performances available for consultation and research. This multimodal recordings‘ database will allow to browse the multimodal recordings using a powerful html5 web based visualizer as well as allow the users to download the recordings for their research analysis. This database will include all data gathered during the recordings done during the whole project.

Final public event

Start-up public event
Website of the Project

Website of the Project (first public version Month 6 and regular updates)

Data Management Plan

Final feature definition and computation algorithms
User-evaluations of each technology in each scenario completed

Publications

Machine learning and music generation

Author(s): José M. Iñesta, Darrell Conklin, Rafael Ramírez
Published in: Journal of Mathematics and Music, Issue 10/2, 2016, Page(s) 87-91, ISSN 1745-9737
Publisher: Taylor and Francis Ltd.
DOI: 10.1080/17459737.2016.1216369

EEG-Based Analysis of the Emotional Effect of Music Therapy on Palliative Care Cancer Patients

Author(s): Rafael Ramirez, Josep Planas, Nuria Escude, Jordi Mercade, Cristina Farriols
Published in: Frontiers in Psychology, Issue 9, 2018, ISSN 1664-1078
Publisher: Frontiers Research Foundation
DOI: 10.3389/fpsyg.2018.00254

Seeking reproducibility: Assessing a multimodal study of the testing effect

Author(s): M. Beardsley, D. Hernández-Leo, R. Ramirez-Melendez
Published in: Journal of Computer Assisted Learning, Issue 34/4, 2018, Page(s) 378-386, ISSN 0266-4909
Publisher: Blackwell Publishing Inc.
DOI: 10.1111/jcal.12265

Mapping between dynamic markings and performed loudness: a machine learning approach

Author(s): Katerina Kosta, Rafael Ramírez, Oscar F. Bandtlow, Elaine Chew
Published in: Journal of Mathematics and Music, Issue 10/2, 2016, Page(s) 149-172, ISSN 1745-9737
Publisher: Taylor and Francis Ltd.
DOI: 10.1080/17459737.2016.1193237

Evaluation of a Sound Quality Visual Feedback System for Bow Learning Technique in Violin Beginners: An EEG Study

Author(s): Angel David Blanco, Rafael Ramirez
Published in: Frontiers in Psychology, Issue 10, 2019, ISSN 1664-1078
Publisher: Frontiers Research Foundation
DOI: 10.3389/fpsyg.2019.00165

Automatic Assessment of Tone Quality in Violin Music Performance

Author(s): Sergio Giraldo, George Waddell, Ignasi Nou, Ariadna Ortega, Oscar Mayor, Alfonso Perez, Aaron Williamon, Rafael Ramirez
Published in: Frontiers in Psychology, Issue 10, 2019, Page(s) 334, ISSN 1664-1078
Publisher: Frontiers Research Foundation
DOI: 10.3389/fpsyg.2019.00334

Bowing Gestures Classification in Violin Performance: A Machine Learning Approach

Author(s): David Dalmazzo, Rafael Ramírez
Published in: Frontiers in Psychology, Issue 10, 2019, ISSN 1664-1078
Publisher: Frontiers Research Foundation
DOI: 10.3389/fpsyg.2019.00344

Analysis of Movement Quality in Full-Body Physical Activities

Author(s): Radoslaw Niewiadomski, Ksenia Kolykhalova, Stefano Piana, Paolo Alborno, Gualtiero Volpe, Antonio Camurri
Published in: ACM Transactions on Interactive Intelligent Systems, Issue 9/1, 2019, Page(s) 1-20, ISSN 2160-6455
Publisher: Association for Computing Machinery (ACM)
DOI: 10.1145/3132369

The EyeHarp: A Gaze-Controlled Digital Musical Instrument

Author(s): Zacharias Vamvakousis, Rafael Ramirez
Published in: Frontiers in Psychology, Issue 7, 2016, ISSN 1664-1078
Publisher: Frontiers Research Foundation
DOI: 10.3389/fpsyg.2016.00906

Enriched Multimodal Representations of Music Performances: Online Access and Visualization

Author(s): Esteban Maestre, Panagiotis Papiotis, Marco Marchini, Quim Llimona, Oscar Mayor, Alfonso Perez, Marcelo M. Wanderley
Published in: IEEE MultiMedia, Issue 24/1, 2017, Page(s) 24-34, ISSN 1070-986X
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/MMUL.2017.3

A Machine Learning Approach to Discover Rules for Expressive Performance Actions in Jazz Guitar Music

Author(s): Sergio I. Giraldo, Rafael Ramirez
Published in: Frontiers in Psychology, Issue 7, 2016, ISSN 1664-1078
Publisher: Frontiers Research Foundation
DOI: 10.3389/fpsyg.2016.01965

A machine learning approach to ornamentation modeling and synthesis in jazz guitar

Author(s): Sergio Giraldo, Rafael Ramírez
Published in: Journal of Mathematics and Music, Issue 10/2, 2016, Page(s) 107-126, ISSN 1745-9737
Publisher: Taylor and Francis Ltd.
DOI: 10.1080/17459737.2016.1207814

A computational approach for measuring performance quality in violin tones

Author(s): Sergio Giraldo; Rafael Ramirez; George Waddell; Aaron Williamon
Published in: Abstracts of the International Symposium in Performance Science (ISPS 2017), Reijavik, Iceland., Issue 4, 2017
Publisher: ISPS
DOI: 10.5281/zenodo.2579194

A realtime feedback learning tool to visualize sound quality in violin performances

Author(s): Sergio Giraldo; Rafael Ramirez; George Waddell; Aaron Williamon
Published in: Issue 4, 2017
Publisher: MML
DOI: 10.5281/zenodo.2580053

Computational modelling of timbre dimensions for automatic violin tone quality assessment

Author(s): Sergio Giraldo; Rafael Ramirez; George Waddell; Aaron Williamon
Published in: Proceedings of the 2018 TIMBRE is a many splendored thing Conference, Montreal, Canada., Issue 2, 2018
Publisher: McGill
DOI: 10.5281/zenodo.2579163

Enhancing Music Learning with Smart Technologies

Author(s): Rafael Ramirez, Alfonso Perez, George Waddell, Aaron Williamon, Corrado Canepa, Simone Ghisio, Ksenia Kolykhalova, Maurizio Mancini, Erica Volta, Gualtiero Volpe, Sergio Giraldo, Oscar Mayor
Published in: Proceedings of the 5th International Conference on Movement and Computing - MOCO '18, 2018, Page(s) 1-4, ISBN 9781-450365048
Publisher: ACM Press
DOI: 10.1145/3212721.3212886

Detection and Regression of Violin Vibrato from Scores and Mobile Devices Rendering for Didactic Purposes

Author(s): Furkan Yesiler, Rafael Ramirez
Published in: Proceedings of the Sound and Music Computing Conference, 2018
Publisher: SMC

Automatically measuring biomechanical skills of violin performance - an exploratory study

Author(s): Erica Volta, Maurizio Mancini, Giovanna Varni, Gualtiero Volpe
Published in: Proceedings of the 5th International Conference on Movement and Computing - MOCO '18, 2018, Page(s) 1-4, ISBN 9781-450365048
Publisher: ACM Press
DOI: 10.1145/3212721.3212840

Automatic assessment of violin performance using dynamic time warping classification

Author(s): Sergio Giraldo, Ariadna Ortega, Alfonso Perez, Rafael Ramirez, George Waddell, Aaron Williamon
Published in: 2018 26th Signal Processing and Communications Applications Conference (SIU), 2018, Page(s) 1-3, ISBN 978-1-5386-1501-0
Publisher: IEEE
DOI: 10.1109/SIU.2018.8404556

A Machine Learning Approach to Classification of Phonation Modes in Singing.

Author(s): Matteo Lionello, Rafael Ramirez
Published in: 2018
Publisher: SMC

Air violin: a machine learning approach to fingering gesture recognition

Author(s): David Dalmazzo, Rafael Ramirez
Published in: Proceedings of the 1st ACM SIGCHI International Workshop on Multimodal Interaction for Education - MIE 2017, 2017, Page(s) 63-66, ISBN 9781-450355575
Publisher: ACM Press
DOI: 10.1145/3139513.3139526

Neural Correlates of Bow Learning Technique

Author(s): Angel David Blanco; Rafael Ramirez
Published in: 10th International Workshop on Machine Learning and Music, 2017
Publisher: MML

Bowing modeling for violin students assistance

Author(s): Fabio J. M. Ortega, Sergio I. Giraldo, Rafael Ramirez
Published in: Proceedings of the 1st ACM SIGCHI International Workshop on Multimodal Interaction for Education - MIE 2017, 2017, Page(s) 60-62, ISBN 9781-450355575
Publisher: ACM Press
DOI: 10.1145/3139513.3139525

Acquisition of Violin Instrumental Gestures Using an Infrared Depth Camera

Author(s): Zacharias Vamvakousis; Alfonso Perez Carrillo; Rafael Ramirez
Published in: Proceedings of the 15th Sound and Music Computing Conference (SMC2018), Limassol, Cyprus, 4-7 July, 2018
Publisher: SMC
DOI: 10.5281/zenodo.1422548

Automated Analysis of Postural and Movement Qualities of Violin Players

Author(s): Erica Volta, Gualtiero Volpe
Published in: 2019 International Workshop on Multilayer Music Representation and Processing (MMRP), 2019, Page(s) 56-59, ISBN 978-1-7281-1649-5
Publisher: IEEE
DOI: 10.1109/mmrp.2019.8665374

Phrase-Level Modeling of Expression in Violin Performances

Author(s): Fabio J. M. Ortega, Sergio I. Giraldo, Rafael Ramirez
Published in: 10th International Workshop on Machine Learning and Music, 2017
Publisher: mml

A Machine Learning Approach to Violin Bow Technique Classification - a Comparison Between IMU and MOCAP systems

Author(s): David Dalmazzo, Simone Tassani, Rafael Ramírez
Published in: Proceedings of the 5th international Workshop on Sensor-based Activity Recognition and Interaction - iWOAR '18, 2018, Page(s) 1-8, ISBN 9781-450364874
Publisher: ACM Press
DOI: 10.1145/3266157.3266216

Evaluation of audio-based feedback technologies for bow learning technique in violin beginners

Author(s): Angel Blanco, Rafael Ramirez
Published in: Proceedings of the 1st ACM SIGCHI International Workshop on Multimodal Interaction for Education - MIE 2017, 2017, Page(s) 41-43, ISBN 9781-450355575
Publisher: ACM Press
DOI: 10.1145/3139513.3139520

Estimation of violin bowing features from Audio recordings with Convolutional Networks

Author(s): A. Perez-Carrillo, H. Purwins
Published in: Conference and Workshop on Neural Information Processing Systems (NIPS), 2017
Publisher: Neural Information Processing Systems Foundation, Inc.

A multimodal corpus for technology-enhanced learning of violin playing

Author(s): Gualtiero Volpe, Ksenia Kolykhalova, Erica Volta, Simone Ghisio, George Waddell, Paolo Alborno, Stefano Piana, Corrado Canepa, Rafael Ramirez-Melendez
Published in: Proceedings of the 12th Biannual Conference on Italian SIGCHI Chapter - CHItaly '17, 2017, Page(s) 1-5, ISBN 9781-450352376
Publisher: ACM Press
DOI: 10.1145/3125571.3125588

Informing bowing and violin learning using movement analysis and machine learning

Author(s): E. Volta, P. Alborno, and G. Volpe
Published in: Proceedings of the 10th International Workshop on Machine Learning and Music, 2017
Publisher: MML
DOI: 10.13140/rg.2.2.24907.49443

Jazz ensemble expressive performance modeling

Author(s): Bantula, Helena; Giraldo, Sergio Iván; Ramírez, Rafael,1966-
Published in: Issue 1, 2016
Publisher: International Society for Music Information Retrieval (ISMIR)
DOI: 10.5281/zenodo.1415876

Exploiting multimodal integration in adaptive interactive systems and game-based learning interfaces

Author(s): Erica Volta, Gualtiero Volpe
Published in: Proceedings of the 5th International Conference on Movement and Computing - MOCO '18, 2018, Page(s) 1-4, ISBN 9781-450365048
Publisher: ACM Press
DOI: 10.1145/3212721.3212849

Acquisition of Human Body Kinematic and Dynamic Features in Violin Performances with Kinect

Author(s): Pablo Fernandez Blanco, Alfonso Perez-Carrillo, Mario Ceresa
Published in: First International Workshop on Motor Learning For Music Performance, Issue 1, 2017, 2017
Publisher: Aalborg University Copenhagen

Statistical models for the indirect acquisition of violin bowing controls from audio analysis

Author(s): Alfonso Perez-Carrillo
Published in: Proceedings of Meetings on Acoustics, Issue 29, 2017, 2017, Page(s) 035003
Publisher: Acoustical Society of America
DOI: 10.1121/2.0000402

ESTIMATION OF BOWING PARAMETERS IN VIOLIN PLAYING FROM AUDIO ANALYSIS

Author(s): Alfonso Perez-Carrillo
Published in: Abstracts of the International Symposium on Performance Science 2017, Issue 1, 2017, 2017, Page(s) 192, ISBN 9789-935937803
Publisher: Iceland Academy of the Arts

JAZZ ENSEMBLE EXPRESSIVE PERFORMANCE MODELING

Author(s): Helena Bantula, Sergio Giraldo and Rafael Ramirez
Published in: 17th International Society for Music Information Retrieval Conference, 2016., Issue Ago 12, 2016, 2016
Publisher: International Society for Music Information Retrieval

A Genetic Approach for Evaluation of Computational Models for Expressive Music Performance in Jazz Guitar

Author(s): Sergio Giraldo and Rafael Ramirez
Published in: 9th International Workshop on Machine Learning, Issue September 23, 2016, 2016
Publisher: MML

HEXAPHONIC GUITAR TRANSCRIPTION AND VISUALISATION

Author(s): Iñigo Angulo Ortegui, Sergio Giraldo, Rafael Ramirez
Published in: Second International Conference on Technologies for Music Notation and Representation, Issue 27-29 May 2016, 2016
Publisher: Anglia Ruskin University

Musical neurofeedback for treating depression in elderly people

Author(s): Rafael Ramirez, Manel Palencia-Lefler, Sergio Giraldo, Zacharias Vamvakousis
Published in: Frontiers in Neuroscience, Issue 9, 2015, ISSN 1662-453X
Publisher: Frontiers
DOI: 10.3389/fnins.2015.00354

Violin Timbre Navigator: Real-Time Visual Feedback of Violin Bowing Based on Audio Analysis and Machine Learning

Author(s): Alfonso Perez-Carrillo
Published in: MultiMedia Modeling - 25th International Conference, MMM 2019, Thessaloniki, Greece, January 8–11, 2019, Proceedings, Part II, Issue 11296, 2019, Page(s) 182-193, ISBN 978-3-030-05715-2
Publisher: Springer International Publishing
DOI: 10.1007/978-3-030-05716-9_15

Searching for OpenAIRE data...

Deliverables

Publications

Share this page

Download