European Commission logo
English English
CORDIS - EU research results
CORDIS

Realtime Adaptive Prototyping for Industrial Design of Multimodal Interactive eXpressive technology

Deliverables

UCD methodology

This deliverable will report a set of methodological tools for the assessment of design needs, with strong focus on industrial and end-user requirements.

Internal quality review planning

Distribution of responsibilities in the internal review process, assignment of co-reviewers, dates, etc.

Design Guidelines for prototyping

This report will contain an initial description of user-centred design specifications and guidelines for rapid prototyping, according to the requirements of SMEs and end-users, and the advice of the Industry Panel.

Project hand book and quality plan

Project hand book and quality plan including all procedures, communication channels and operational framework.

Final report on MIX technology completion and qualification

Final report on the performance of MIX technologies as completed and qualified systems for the creative industry field.

Report on technologies available and APIs to be developed

This report will contain a detailed description and analysis of the partners’ PoCs and candidate technologies, which will have been tested, compared, and classified according to their application domains and their Technology Readiness Levels (TRLs). Expected TRLs at this stage: TRL4 and TRL5.

Second report with user feedback and improvements to the MIX technology

This report will describe the feedback of the tests made to prototypes for the RAPID-API and intermediate integrated MIX products, together with a qualified set of changes to the Design Guidelines that can be used to mature natural, seamless MIX products to a market-ready stage (TRL8).

Design Specifications for MIX products

This deliverable updates the user-centred design specifications defined in 2.3 and incorporates guidelines for the development of MIX products, according to the requirements of SMEs and end-users, and the advice of the Industry Panel.

Assessment report with user feedback and improvements to the prototypes

This report will describe the feedback of the tests made to the early prototypes and intermediate integrated MIX products, together with a qualified set of changes to the Design Guidelines that can be used to mature natural, seamless MIX technology for being used in operational environments (TRL 7).

Design Guidelines for the RAPID-API

This deliverable updates the user-centred design specifications defined in 2.2 to include guidelines for the RAPID-API development, according to the requirements of SMEs and end-users, and the advice of the Industry Panel.

Final version of MIX products

Final Delivery of MIX products based on the RAPID-API, at TRL8, completed and qualified (T5.4)

Second and final version of the RAPID-API

This deliverable updates D4.3, incorporating feedback from prototypes testing documented in D2.4. The deliverable concludes the API development, with and complete API (the RAPID-API), including software, hardware and middleware components for the implementation of novel, natural and multimodal interactive solutions. Expected TRLs at the end of the phase: TRL7.

Early prototypes V2

This deliverable will update the first version of the early hardware and software prototypes, as defined by D3.1. The outcomes of this phase will be used in T2.3 and T6.1 for design testing and end-user evaluation.

API demonstrators

This deliverable will provide prototypes to demonstrate advanced features of the RAPID-API, complementary to the products integrated in WP5 and applied to different domains to show possible contributions to other European industries.

First version of MIX products

First Delivery of early MIX products at TRL6, demonstrated in relevant environments (T5.2).

Second version of MIX products

Delivery of MIX products based on the RAPID-API, at TRL7, demonstrated in operational environments (T5.3)

First version of RAPID-API incl. Software, Hardware and middleware

This deliverable will include the first version of the software and hardware APIs, following the feedback from industrial and end users, and the specifications documented in D2.4. Software APIs will provide application level access to compiled C and C++ libraries; hardware APIs, for programmable integrated circuit (PIC) and microcontrollers. The outcomes of this phase will be used in T3.2 in a fast-cycle manner. Expected TRLs at the end of the phase: TRL6-TRL7.

Prototype for RAPID-API testing

This deliverable will include prototypes developed with the software, hardware and middleware components of the RAPID-API, following the design guidelines defined in T2.4 and using the technology provided by T4.2,T4.3 and T4.4.The outcomes of this phase will be used in T2.3 and T6.2 for design testing and end-user evaluation.

Early prototypes V1

This deliverable will include the first version of the early hardware and software prototypes, following the design guidelines defined in T2.4 and using the candidate technologies selected in T4.1. The outcomes of this phase will be used in T2.3 for testing early design guidelines.

Definition of the middleware protocol

This deliverable will define a communication protocol to be used in the rapid prototyping phase (T3.2) and in the integration of software and hardware components for the implementation of multimodal interactive solutions (WP5). It will become the standard protocol in transaction multimodal data handling between RAPID-API and MIX products.

Publications

The RAPID-MIX API, a toolkit for fostering innovation in the creative industries with Multimodal, Interactive and eXpressive (MIX) technology

Author(s): Francisco Bernardo, Michael Zbyszynski , Rebecca Fiebrink, Mick Grierson, Frederic Bevilacqua, Joseph Laralde, Sebastian Mealla, Panos Papiotis, Carles Julia.
Published in: 13th International Summer Workshop on Multimodal Interfaces, eNTERFACE 2017, 3 – 28 July, Porto, Portugal, 2017
Publisher: Catholic University of Porto

PiPo, A Plugin Interface for Afferent Data Stream Processing Modules

Author(s): Schnell, Norbert; Schwarz, Diemo; Larralde, Joseph; Borghesi, Riccardo
Published in: International Symposium on Music Information Retrieval (ISMIR), Issue 1, 2017
Publisher: ISMIR

LFO – A graph-based modular approach to the processing of data streams

Author(s): Matuszewski, B. and Schnell, N.
Published in: Proceedings of the Web Audio Conference, 2017
Publisher: WAC-2017

Write once run anywhere revisited: machine learning and audio tools in the browser with C++ and emscripten

Author(s): Zbyszynski, Michael; Grierson, Mick; Yee-King, Matthew; Fedden, leon
Published in: Web Audio Conference 2017, Issue 3, 2017, Page(s) 21-23
Publisher: Queen Mary University of London

Designing gestures for interactive systems: Towards multicultural perspectives

Author(s): Dubos, A., Bevilacqua, F., Larralde, J., Chevrier, J., and J ́ego, J.-F.
Published in: Proceedings of the Interact’17 Conference, Issue LNCS-10516 (Part IV), 2017, Page(s) pp.524-526
Publisher: Lecture Notes in Computer Science

Prototypes for exploring gestural interaction using smartphones

Author(s): Bevilacqua, F., Larralde, J. and Matuszewski, B
Published in: Adjunct proceedings of the Interact’17 Conference, 2017
Publisher: Lecture Notes in Computer Science

Rapid Prototyping of New Instruments with CodeCircle

Author(s): Zbyszynski, Michael; Grierson, Mick; Yee-King, Matthew
Published in: New Interfaces for Musical Expression, Issue 4, 2017
Publisher: NIME

O Soli Mio: Exploring Millimeter Wave Radar for Musical Interaction

Author(s): Bernardo, F., Arner, N., Batchelor, P.
Published in: Proceedings of New Interfaces for Musical Expression 2017, 2017
Publisher: Aalborg University

Shaping and Exploring Interactive Motion-Sound Mappings Using Online Clustering Techniques

Author(s): Scurto, Hugo; Bevilacqua, Frédéric; Françoise, Jules
Published in: https://hal.archives-ouvertes.fr/hal-01577806, Issue 3, 2017
Publisher: NIME

Sound Design In The Cloud

Author(s): Visda Goudarzi, Mathieu Barthet, György Fazeka, Francisco Bernardo, Rebecca Fiebrink, Michael Zbyszyński, Chunghsin Yeh
Published in: AudioMostly 2017, 2017
Publisher: Queen Mary University of London

Demonstrating Interactive Machine Learning Tools for Rapid Prototyping of Gestural Instruments in the Browser

Author(s): Parkinson, A., Zbyszynski, M., Bernardo, F.
Published in: Proceedings of Web Audio Conference 2017, 2017
Publisher: Queen Mary University of London

Prototyping interactions with Online Multimodal Repositories and Interactive Machine Learning

Author(s): Carles F. Juliá, Panos Papiotis, Sebastian Mealla Cincuegrani, Sergi Jordá
Published in: Proceedings of the 3rd International Symposium on Movement and Computing - MOCO '16, 2016, Page(s) 1-2, ISBN 9781-450343077
Publisher: ACM Press
DOI: 10.1145/2948910.2948915

Prototyping interactions with Online Multimodal Repositories and Interactive Machine Learning

Author(s): Carles F. Juliá, Panos Papiotis, Sebastian Mealla Cincuegrani, Sergi Jordà
Published in: Proceedings of the 3rd International Symposium on Movement and Computing Conference, 2016
Publisher: ACM New York

Interactive Machine Learning for End-User Interaction

Author(s): Francisco Bernardo, Michael Zbyszynski, Rebecca Fiebrink, Mick Grierson
Published in: Designing the User Experience of Machine Learning Systems, 2017
Publisher: AAAI Spring Symposium Series

Gaussbox: Prototyping movement interaction with interactive visualizations of machine learning.

Author(s): Jules Françoise, Frédéric Bevilacqua, and Thecla Schiphorst
Published in: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, CHI EA ’16, pages 3667–3670, 2016
Publisher: ACM New York
DOI: 10.1145/2851581.2890257

The Machine Learning Algorithm As Creative Musical Tool.

Author(s): Fiebrink, R., and B. Caramiaux
Published in: The Oxford Handbook of Algorithmic Music, 2018
Publisher: Oxford University Press.

Enriched Multimodal Representations of Music Performances: Online Access and Visualization

Author(s): Esteban Maestre, Panagiotis Papiotis, Marco Marchini, Quim Llimona, Oscar Mayor, Alfonso Perez, Marcelo M. Wanderley
Published in: IEEE MultiMedia, Issue 24/1, 2017, Page(s) 24-34, ISSN 1070-986X
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/MMUL.2017.3

Searching for OpenAIRE data...

There was an error trying to search data from OpenAIRE

No results available