Interactive Music Science Collaborative Activities

Projektinformationen

iMuSciCA

ID Finanzhilfevereinbarung: 731861

DOI

10.3030/731861

Projekt abgeschlossen

EK-Unterschriftsdatum 13 Oktober 2016

Startdatum 1 Januar 2017

Enddatum 30 Juni 2019

Finanziert unter

• INDUSTRIAL LEADERSHIP - Leadership in enabling and industrial technologies - Information and Communication Technologies (ICT)

Gesamtkosten

€ 3 224 970,00

EU-Beitrag

€ 2 673 745,00

Koordiniert durch

ATHINA-EREVNITIKO KENTRO KAINOTOMIAS STIS TECHNOLOGIES TIS PLIROFORIAS, TON EPIKOINONION KAI TIS GNOSIS
Greece

CORDIS bietet Links zu öffentlichen Ergebnissen und Veröffentlichungen von HORIZONT-Projekten.

Links zu Ergebnissen und Veröffentlichungen von RP7-Projekten sowie Links zu einigen Typen spezifischer Ergebnisse wie Datensätzen und Software werden dynamisch von OpenAIRE abgerufen.

Leistungen

Demonstrators, pilots, prototypes (27)

Final Gesture and VR tools for music interaction and co-creation

Final version of the demonstrator for gesture and VR tools for music interaction and co-creation.

Final Version of Gesture and VR multimodal interaction interface

Final version of the demonstrator for gesture and VR multimodal interaction interface.

Intermediate Gesture and VR tools for music interaction and co-creation

Intermediate version of the demonstrator for gesture and VR tools for music interaction and co-creation.

Final Music activities based on mathematical equations and geometric curves

Final version of the demonstrator for the music activities based on mathematical equations and geometric curves.

Final Version of Computational models for sound and music generation for virtual instruments

Final version of the demonstrator for the computational models for sound and music generation for virtual instruments.

First Version of Actuation technology of actual physical instruments

First version of the actuation technology applied on actual physical instruments.

Initial Gesture and VR tools for music interaction and co-creation

Initial version of the demonstrator for gesture and VR tools for music interaction and co-creation.

Intermediate Demonstrators of iMuSciCA workbench toolkits

Intermediate version of the demonstrators of iMuSciCA workbench toolkits.

Final Version of Pen-enabled multimodal interaction interface

Final version of the demonstrator for pen-enabled multimodal interaction interface.

Final Version of Music visualization and analysis tools

Final version of the music visualization and analysis tools to be integrated in the iMuSciCA workbench.

First Version of Computational models for sound and music generation for virtual instruments

First version of the demonstrator for the computational models for sound and music generation for virtual instruments.

Final Version of Actuation technology of actual physical instruments

Final version of the actuation technology applied on actual physical instruments.

Initial 3D musical instrument interactive design kit

Initial version of the 3D musical instrument interactive design kit.

Intermediate 3D musical instrument interactive design kit

Intermediate version of the 3D musical instrument interactive design kit.

First Version of Gesture and VR multimodal interaction interface

First version of the demonstrator for gesture and VR multimodal interaction interface.

Initial Pen-enabled canvas for music and audio co-creation and interaction

Initial version of the demonstrator for pen-enabled canvas for music and audio co-creation and interaction.

Initial Demonstrators of iMuSciCA workbench toolkits

Initial version of the demonstrators of iMuSciCA workbench toolkits.

Initial Music activities based on mathematical equations and geometric curves

Initial version of the demonstrator for the music activities based on mathematical equations and geometric curves.

First Version of Music visualization and analysis tools

First version of the music visualization and analysis tools to be integrated in the iMuSciCA workbench.

First Version of 3D design environment for musical instruments

First version of the 3D design environment for musical instruments.

Intermediate Pen-enabled canvas for music and audio co-creation and interaction

Intermediate version of the demonstrator for pen-enabled canvas for music and audio co-creation and interaction.

Intermediate Music activities based on mathematical equations and geometric curves

Intermediate version of the demonstrator for the music activities based on mathematical equations and geometric curves.

Final 3D musical instrument interactive design kit

Final version of the 3D musical instrument interactive design kit.

First Version of Pen-enabled multimodal interaction interface

First Version of Pen-enabled multimodal interaction interface.

Final Demonstrators of iMuSciCA workbench toolkits

Final version of the demonstrators of iMuSciCA workbench toolkits.

Final Version of 3D design environment for musical instruments

First version of the 3D design environment for musical instruments.

Final Pen-enabled canvas for music and audio co-creation and interaction

Final version of the demonstrator for pen-enabled canvas for music and audio co-creation and interaction.

Documents, reports (20)

Interim report on teacher’s feedback and pilot testing in schools (A-Cycle)

Report on teacher’s feedback after the 1st cycle pilot testing in schools.

Report on Teachers training communities

Report on the teachers training communities.

Dissemination and Communication plan

First draft plan for dissemination and communication to the scientific, industry and general public.

Final Evaluation metrics for deeper learning with iMuSciCA

Report on the final version (after the first pilot testing cycle) of the evaluation metrics to be used to access deeper learning with iMuSciCA.

Final Version of Usability validation of iMuSciCA toolkits

Report on the final version of the usability validation of iMuSciCA toolkits in the first pilot testing cycle.

Pilot testing action plan

A practical guide to every aspect of piloting activities in accordance with the pedagogical framework and the technical progress of the project.

Initial Pedagogical framework and iMuSciCA use cases by learners and teachers

Report on the initial pedagogical framework and the iMuSciCA use cases for team learning/teaching by learners and teachers.

Final report on teacher’s feedback and pilot testing in schools (B-Cycle)

Report on teacher’s feedback after the 2nd cycle pilot testing in schools.

First Report on Dissemination activities

Report on the dissemination activities up to the mid-term of the project.

Final Report on Dissemination activities

Report on the dissemination activities throughout the lifespan of the project.

Intermediate Pedagogical framework and iMuSciCA use cases by learners and teachers

Report on the updated (intermediate) version of the pedagogical framework and the iMuSciCA use cases for team learning/teaching by learners and teachers following the first cycle of pilot testing.

Final progress report

Final project progress report for the activities throughout the lifespan of the project.

Initial Evaluation metrics for deeper learning with iMuSciCA

Report on the initial version of the evaluation metrics to be used to access deeper learning with iMuSciCA.

Report on Professional development activities for teachers adopting STEAM

Report on the professional development activities for teachers adopting STEAM.

Quantitative and qualitative results of learners - aspects of deeper learning with iMuSciCA

Quantitative and qualitative results of learners behavioural data streams during the interaction with the iMuSciCA workbench.

Progress report for 1st period

Project progress report for the activities up to month 18.

Final Pedagogical framework and iMuSciCA use cases by learners and teachers

Report on the updated (final) version of the pedagogical framework and the iMuSciCA use cases for team learning/teaching by learners and teachers.

First Version of Usability validation of iMuSciCA toolkits

Report on the first version of the usability validation of iMuSciCA toolkits in the first pilot testing cycle.

First Report on Communication and outreach activities

Report on the communication and outreach activities up to the mid-term of the project.

Final Report on Communication and outreach activities

Report on the communication and outreach activities throughout the lifespan of the project.

Other (3)

Final Educational scenarios and lesson plans for iMuSciCA

Final version of the educational scenarios and lesson plans based on the for iMuSciCA workbench.

Intermediate Educational scenarios and lesson plans for iMuSciCA

Intermediate version of the educational scenarios and lesson plans based on the for iMuSciCA workbench.

Initial Educational scenarios and lesson plans for iMuSciCA

Initial version of the educational scenarios and lesson plans based on the for iMuSciCA workbench.

Veröffentlichungen

Conference proceedings (13)

Convolutional Neural Networks for Real-Time Beat Tracking: A Dancing Robot Application

Autoren: Gkiokas, Aggelos; Katsouros, Vassilis
Veröffentlicht in: Proceedings of ISMIR 2017, 2017, Seite(n) 286-293, ISBN 978-981-11-5179-8
Herausgeber: -
DOI: 10.5281/zenodo.1196302

A web-based 3D environment for gestural interaction with virtual music instruments as a STEAM education tool

Autoren: Kosmas Kritsis, Aggelos Gkiokas, Carlos Acosta, Quentin Lamerand, Robert Piéchaud, Maximos Kaliakatsos-Papakostas, and Vassilis Katsouros
Veröffentlicht in: Proceedings of 2018 NIME - The International Conference on New Interfaces for Musical Expression, June 3-6, 2018, Blacksburg, Virginia, USA., 2018, Seite(n) 348-349
Herausgeber: NIME
DOI: 10.5281/zenodo.1341717

Deployment of LSTMs for Real-Time Hand Gesture Interaction of 3D Virtual Music Instruments with a Leap Motion Sensor

Autoren: Kosmas Kritsis, Aggelos Gkiokas, Maximos Kaliakatsos-Papakostas, Vassilis Katsouros, and Aggelos Pikrakis
Veröffentlicht in: In Proceedings of the 15th Sound and Music Computing Conference (SMC 2018), 2018, Seite(n) 342-349
Herausgeber: SMC
DOI: 10.5281/zenodo.1258041

Design and Interaction of 3D Virtual Music Instruments for STEAM Education Using Web Technologies

Autoren: Kosmas Kritsis, Aggelos Gkiokas, Quentin Lamerand, Robert Piéchaud, Carlos Acosta, Maximos Kaliakatsos-Papakostas, and Vassilis Katsouros
Veröffentlicht in: In Proceedings of the 15th Sound and Music Computing Conference (SMC 2018), 2018, Seite(n) 312-318
Herausgeber: SMC
DOI: 10.5281/zenodo.1341741

A Collaborative System for Composing Music via Motion Using a Kinect Sensor and Skeletal Data

Autoren: Christos Garoufis, Athanasia Zlatintsi, and Petros Maragos
Veröffentlicht in: In Proceedings of the 15th Sound and Music Computing Conference (SMC 2018), 2018, Seite(n) 415-422
Herausgeber: SMC
DOI: 10.5281/zenodo.1341738

Crowdsourcing Online Handwriting Acquisition to Develop and Deploy a Unicode Character Classifier

Autoren: Francisco Álvaro and Daniel Martín-Albo
Veröffentlicht in: In Proceedings of the 2018 16th International Conference on Frontiers in Handwriting Recognition (ICFHR), 2018
Herausgeber: IEEE

Interactive Control of Explicit Musical Features in Generative LSTM-based Systems

Autoren: Maximos Kaliakatsos-Papakostas, Aggelos Gkiokas and Vassilis Katsouros
Veröffentlicht in: In Proceeding of the 2018 Audio Mostly: Sound in Immersion and Emotion, 2018
Herausgeber: ACM

Extension of the Sigma Log-Normal Model to Three Dimensions

Autoren: Roman Schindler, Manuel Bouillon, Réjean Plamondon and Andreas Fischer
Veröffentlicht in: Proceedings of the International Conference on Pattern Recognition and Artificial Intelligence (ICPRAI) 2018, 2018
Herausgeber: ICPRAI

Polyphonic STEAM and the role of physics

Autoren: Frans, R., & Andreotti, E.
Veröffentlicht in: Proceedings of the 2017 GIREP-ICPE-EPEC 2017 Conference at Dublin City University, 2018
Herausgeber: GIREP-ICPE-EPEC

A Web-based Real-Time Kinect Application for Gestural Interaction with Virtual Musical Instruments

Autoren: Athanasia Zlatintsi, Panagiotis P. Filntisis, Christos Garoufis, Antigoni Tsiami, Kosmas Kritsis, Maximos Kaliakatsos-Papakostas, Aggelos Gkiokas, Vassilis Katsouros and Petros Maragos
Veröffentlicht in: In Proceeding of the 2018 Audio Mostly: Sound in Immersion and Emotion, 2018
Herausgeber: ACM

DrAwME: Drawing Canvas for Music Creation - A New Tool for Inquiry Learning

Autoren: Manuel Bouillon, Fotini Simistira, Rolf Ingold and Marcus Liwicki
Veröffentlicht in: Proceedings of the 4th International Conference on Learning and Teaching (ICLT) 2018, 2018
Herausgeber: International Journal of Learning and Teaching

Deep Convolutional and LSTM Neural Network Architectures on Leap Motion Hand Tracking Data Sequences

Autoren: K. Kritsis, M. Kaliakatsos-Papakostas, V. Katsouros and A. Pikrakis
Veröffentlicht in: 27th European Signal Processing Conference, 2019
Herausgeber: EUSIPCO 2019

An Environment for Gestural Interaction with 3D Virtual Musical Instruments as an Educational Tool

Autoren: C. Garoufis, A. Zlatintsi, K. Kritsis, P.P. Filntisis, V. Katsouros and P. Maragos
Veröffentlicht in: EUSIPCO 2019, 2019
Herausgeber: EUSIPCO 2019

Book chapters (1)

iMuSciCA: Interactive Music Science Collaborative Activities for STEAM learning

Autoren: Vassilis Katsouros, Evita Fotinea, Renaat Frans, Erica Andreotti, Petros Stergiopoulos, Manolis Chaniotakis, Thomas Fischer, Robert Piechaud, Zoltan Karpati, Pierre Laborde, Daniel Martín-Albo, Fotini Simistira, and Marcus Liwicki
Veröffentlicht in: "In ""Designing for the User Experience in Learning Systems,"" Eds. Evangelos Kapros and Maria Koutsombogera, Human-Computer Interaction Series", 2018, ISBN 978-3-319-94794-5
Herausgeber: Springer

Peer reviewed articles (1)

The connection between physics, engineering and music as an example of STEAM education

Autoren: Andreotti, E., & Frans, R.
Veröffentlicht in: Physics Education, 2019, ISSN 1361-6552
Herausgeber: iopscience
DOI: 10.5281/zenodo.3358408