Interactive Music Science Collaborative Activities

Risultati finali

Demonstrators, pilots, prototypes (27)

Final Gesture and VR tools for music interaction and co-creation

Final version of the demonstrator for gesture and VR tools for music interaction and co-creation.

Final Version of Gesture and VR multimodal interaction interface

Final version of the demonstrator for gesture and VR multimodal interaction interface.

Intermediate Gesture and VR tools for music interaction and co-creation

Intermediate version of the demonstrator for gesture and VR tools for music interaction and co-creation.

Final Music activities based on mathematical equations and geometric curves

Final version of the demonstrator for the music activities based on mathematical equations and geometric curves.

Final Version of Computational models for sound and music generation for virtual instruments

Final version of the demonstrator for the computational models for sound and music generation for virtual instruments.

First Version of Actuation technology of actual physical instruments

First version of the actuation technology applied on actual physical instruments.

Initial Gesture and VR tools for music interaction and co-creation

Initial version of the demonstrator for gesture and VR tools for music interaction and co-creation.

Intermediate Demonstrators of iMuSciCA workbench toolkits

Intermediate version of the demonstrators of iMuSciCA workbench toolkits.

Final Version of Pen-enabled multimodal interaction interface

Final version of the demonstrator for pen-enabled multimodal interaction interface.

Final Version of Music visualization and analysis tools

Final version of the music visualization and analysis tools to be integrated in the iMuSciCA workbench.

First Version of Computational models for sound and music generation for virtual instruments

First version of the demonstrator for the computational models for sound and music generation for virtual instruments.

Final Version of Actuation technology of actual physical instruments

Final version of the actuation technology applied on actual physical instruments.

Initial 3D musical instrument interactive design kit

Initial version of the 3D musical instrument interactive design kit.

Intermediate 3D musical instrument interactive design kit

Intermediate version of the 3D musical instrument interactive design kit.

First Version of Gesture and VR multimodal interaction interface

First version of the demonstrator for gesture and VR multimodal interaction interface.

Initial Pen-enabled canvas for music and audio co-creation and interaction

Initial version of the demonstrator for pen-enabled canvas for music and audio co-creation and interaction.

Initial Demonstrators of iMuSciCA workbench toolkits

Initial version of the demonstrators of iMuSciCA workbench toolkits.

Initial Music activities based on mathematical equations and geometric curves

Initial version of the demonstrator for the music activities based on mathematical equations and geometric curves.

First Version of Music visualization and analysis tools

First version of the music visualization and analysis tools to be integrated in the iMuSciCA workbench.

First Version of 3D design environment for musical instruments

First version of the 3D design environment for musical instruments.

Intermediate Pen-enabled canvas for music and audio co-creation and interaction

Intermediate version of the demonstrator for pen-enabled canvas for music and audio co-creation and interaction.

Intermediate Music activities based on mathematical equations and geometric curves

Intermediate version of the demonstrator for the music activities based on mathematical equations and geometric curves.

Final 3D musical instrument interactive design kit

Final version of the 3D musical instrument interactive design kit.

First Version of Pen-enabled multimodal interaction interface

First Version of Pen-enabled multimodal interaction interface.

Final Demonstrators of iMuSciCA workbench toolkits

Final version of the demonstrators of iMuSciCA workbench toolkits.

Final Version of 3D design environment for musical instruments

First version of the 3D design environment for musical instruments.

Final Pen-enabled canvas for music and audio co-creation and interaction

Final version of the demonstrator for pen-enabled canvas for music and audio co-creation and interaction.

Documents, reports (20)

Interim report on teacher’s feedback and pilot testing in schools (A-Cycle)

Report on teacher’s feedback after the 1st cycle pilot testing in schools.

Report on Teachers training communities

Report on the teachers training communities.

Dissemination and Communication plan

First draft plan for dissemination and communication to the scientific, industry and general public.

Final Evaluation metrics for deeper learning with iMuSciCA

Report on the final version (after the first pilot testing cycle) of the evaluation metrics to be used to access deeper learning with iMuSciCA.

Final Version of Usability validation of iMuSciCA toolkits

Report on the final version of the usability validation of iMuSciCA toolkits in the first pilot testing cycle.

Pilot testing action plan

A practical guide to every aspect of piloting activities in accordance with the pedagogical framework and the technical progress of the project.

Initial Pedagogical framework and iMuSciCA use cases by learners and teachers

Report on the initial pedagogical framework and the iMuSciCA use cases for team learning/teaching by learners and teachers.

Final report on teacher’s feedback and pilot testing in schools (B-Cycle)

Report on teacher’s feedback after the 2nd cycle pilot testing in schools.

First Report on Dissemination activities

Report on the dissemination activities up to the mid-term of the project.

Final Report on Dissemination activities

Report on the dissemination activities throughout the lifespan of the project.

Intermediate Pedagogical framework and iMuSciCA use cases by learners and teachers

Report on the updated (intermediate) version of the pedagogical framework and the iMuSciCA use cases for team learning/teaching by learners and teachers following the first cycle of pilot testing.

Final progress report

Final project progress report for the activities throughout the lifespan of the project.

Initial Evaluation metrics for deeper learning with iMuSciCA

Report on the initial version of the evaluation metrics to be used to access deeper learning with iMuSciCA.

Report on Professional development activities for teachers adopting STEAM

Report on the professional development activities for teachers adopting STEAM.

Quantitative and qualitative results of learners - aspects of deeper learning with iMuSciCA

Quantitative and qualitative results of learners behavioural data streams during the interaction with the iMuSciCA workbench.

Progress report for 1st period

Project progress report for the activities up to month 18.

Final Pedagogical framework and iMuSciCA use cases by learners and teachers

Report on the updated (final) version of the pedagogical framework and the iMuSciCA use cases for team learning/teaching by learners and teachers.

First Version of Usability validation of iMuSciCA toolkits

Report on the first version of the usability validation of iMuSciCA toolkits in the first pilot testing cycle.

First Report on Communication and outreach activities

Report on the communication and outreach activities up to the mid-term of the project.

Final Report on Communication and outreach activities

Report on the communication and outreach activities throughout the lifespan of the project.

Other (3)

Final Educational scenarios and lesson plans for iMuSciCA

Final version of the educational scenarios and lesson plans based on the for iMuSciCA workbench.

Intermediate Educational scenarios and lesson plans for iMuSciCA

Intermediate version of the educational scenarios and lesson plans based on the for iMuSciCA workbench.

Initial Educational scenarios and lesson plans for iMuSciCA

Initial version of the educational scenarios and lesson plans based on the for iMuSciCA workbench.

Pubblicazioni

Conference proceedings (13)

Convolutional Neural Networks for Real-Time Beat Tracking: A Dancing Robot Application

Autori: Gkiokas, Aggelos; Katsouros, Vassilis
Pubblicato in: Proceedings of ISMIR 2017, 2017, Page(s) 286-293, ISBN 978-981-11-5179-8
Editore: -
DOI: 10.5281/zenodo.1196302

A web-based 3D environment for gestural interaction with virtual music instruments as a STEAM education tool

Autori: Kosmas Kritsis, Aggelos Gkiokas, Carlos Acosta, Quentin Lamerand, Robert Piéchaud, Maximos Kaliakatsos-Papakostas, and Vassilis Katsouros
Pubblicato in: Proceedings of 2018 NIME - The International Conference on New Interfaces for Musical Expression, June 3-6, 2018, Blacksburg, Virginia, USA., 2018, Page(s) 348-349
Editore: NIME
DOI: 10.5281/zenodo.1341717

Deployment of LSTMs for Real-Time Hand Gesture Interaction of 3D Virtual Music Instruments with a Leap Motion Sensor

Autori: Kosmas Kritsis, Aggelos Gkiokas, Maximos Kaliakatsos-Papakostas, Vassilis Katsouros, and Aggelos Pikrakis
Pubblicato in: In Proceedings of the 15th Sound and Music Computing Conference (SMC 2018), 2018, Page(s) 342-349
Editore: SMC
DOI: 10.5281/zenodo.1258041

Design and Interaction of 3D Virtual Music Instruments for STEAM Education Using Web Technologies

Autori: Kosmas Kritsis, Aggelos Gkiokas, Quentin Lamerand, Robert Piéchaud, Carlos Acosta, Maximos Kaliakatsos-Papakostas, and Vassilis Katsouros
Pubblicato in: In Proceedings of the 15th Sound and Music Computing Conference (SMC 2018), 2018, Page(s) 312-318
Editore: SMC
DOI: 10.5281/zenodo.1341741

A Collaborative System for Composing Music via Motion Using a Kinect Sensor and Skeletal Data

Autori: Christos Garoufis, Athanasia Zlatintsi, and Petros Maragos
Pubblicato in: In Proceedings of the 15th Sound and Music Computing Conference (SMC 2018), 2018, Page(s) 415-422
Editore: SMC
DOI: 10.5281/zenodo.1341738

Crowdsourcing Online Handwriting Acquisition to Develop and Deploy a Unicode Character Classifier

Autori: Francisco Álvaro and Daniel Martín-Albo
Pubblicato in: In Proceedings of the 2018 16th International Conference on Frontiers in Handwriting Recognition (ICFHR), 2018
Editore: IEEE

Interactive Control of Explicit Musical Features in Generative LSTM-based Systems

Autori: Maximos Kaliakatsos-Papakostas, Aggelos Gkiokas and Vassilis Katsouros
Pubblicato in: In Proceeding of the 2018 Audio Mostly: Sound in Immersion and Emotion, 2018
Editore: ACM

Extension of the Sigma Log-Normal Model to Three Dimensions

Autori: Roman Schindler, Manuel Bouillon, Réjean Plamondon and Andreas Fischer
Pubblicato in: Proceedings of the International Conference on Pattern Recognition and Artificial Intelligence (ICPRAI) 2018, 2018
Editore: ICPRAI

Polyphonic STEAM and the role of physics

Autori: Frans, R., & Andreotti, E.
Pubblicato in: Proceedings of the 2017 GIREP-ICPE-EPEC 2017 Conference at Dublin City University, 2018
Editore: GIREP-ICPE-EPEC

A Web-based Real-Time Kinect Application for Gestural Interaction with Virtual Musical Instruments

Autori: Athanasia Zlatintsi, Panagiotis P. Filntisis, Christos Garoufis, Antigoni Tsiami, Kosmas Kritsis, Maximos Kaliakatsos-Papakostas, Aggelos Gkiokas, Vassilis Katsouros and Petros Maragos
Pubblicato in: In Proceeding of the 2018 Audio Mostly: Sound in Immersion and Emotion, 2018
Editore: ACM

DrAwME: Drawing Canvas for Music Creation - A New Tool for Inquiry Learning

Autori: Manuel Bouillon, Fotini Simistira, Rolf Ingold and Marcus Liwicki
Pubblicato in: Proceedings of the 4th International Conference on Learning and Teaching (ICLT) 2018, 2018
Editore: International Journal of Learning and Teaching

Deep Convolutional and LSTM Neural Network Architectures on Leap Motion Hand Tracking Data Sequences

Autori: K. Kritsis, M. Kaliakatsos-Papakostas, V. Katsouros and A. Pikrakis
Pubblicato in: 27th European Signal Processing Conference, 2019
Editore: EUSIPCO 2019

An Environment for Gestural Interaction with 3D Virtual Musical Instruments as an Educational Tool

Autori: C. Garoufis, A. Zlatintsi, K. Kritsis, P.P. Filntisis, V. Katsouros and P. Maragos
Pubblicato in: EUSIPCO 2019, 2019
Editore: EUSIPCO 2019

Book chapters (1)

iMuSciCA: Interactive Music Science Collaborative Activities for STEAM learning

Autori: Vassilis Katsouros, Evita Fotinea, Renaat Frans, Erica Andreotti, Petros Stergiopoulos, Manolis Chaniotakis, Thomas Fischer, Robert Piechaud, Zoltan Karpati, Pierre Laborde, Daniel Martín-Albo, Fotini Simistira, and Marcus Liwicki
Pubblicato in: "In ""Designing for the User Experience in Learning Systems,"" Eds. Evangelos Kapros and Maria Koutsombogera, Human-Computer Interaction Series", 2018, ISBN 978-3-319-94794-5
Editore: Springer

Peer reviewed articles (1)

The connection between physics, engineering and music as an example of STEAM education

Autori: Andreotti, E., & Frans, R.
Pubblicato in: Physics Education, 2019, ISSN 1361-6552
Editore: iopscience
DOI: 10.5281/zenodo.3358408

Set di dati

Set di dati mediante OpenAIRE (2)

First Version of iMuSciCA 3D Interaction module

Autori: Kritsis, Kosmas; Gkiokas, Aggelos; Acosta, Carlos; Lamerand, Quentin; Piéchaud, Robert; Kaliakatsos-Papakostas, Maximos; Katsouros, Vassilis
Pubblicato in: Zenodo

Leap Motion Hand Gestures For Interaction With 3D Virtual Music Instruments (Lmhgif3Dvmi)

Autori: Kritsis, Kosmas; Gkiokas, Aggelos; Kaliakatsos-Papakostas, Maximos; Katsouros, Vassilis; Pikrakis, Aggelos
Pubblicato in: Zenodo