CORDIS
EU research results

CORDIS

English EN

Multisensory Expressive Gesture Applications

Objective

The project is centred on the modelling and real-time analysis, synthesis, and networked communication of expressive and emotional content in non-verbal interaction by multi-sensory interfaces, from a multi-modal perspective. Music (incl. singing voice) and movement (incl. dance) are first class channels for conveying expressive and emotional content. A project mission is to deliver products and related applications and services: for each product, the work is organized in three development cycles converging to the final release in a three-phase spiral approach. Each product is developed on the basis of industry standards and architectures, including those developed by partners in the consortium. Since the early stages, the project will deliver working prototypes for early validation, experiments with groups of users. At the end of each of the three basic project cycles, the prototypes will be installed and validated with a larger number of users in public events (e.g., exhibit, artistic and music performance, workshops). The demonstration of project results in public events will also contribute to dissemination. The partners in the consortium already developed an internationally awarded concrete basis of consolidated research and technology which will be directly transferable into the project at its startup.

Objectives:
Strategic and economical objectives include:
(i) consolidation of a European route original in both cultural and scientific content with respect to Affective Computing (USA) and KANSEI Information Processing (Japan);
(ii) dramatic raising of the competitiveness of European Industry of Digital Music Instruments (suffering from the aggressive Japan and USA industry), of Entertainment and Multimedia Industry.

Work description:
The project is centred on the modelling and real-time analysis, synthesis, and networked communication of expressive and emotional content in non-verbal interaction by multi-sensory interfaces, from a multi-modal perspective. Music (including singing voice) and movement (including dance) are first class channels for conveying expressive and emotional content. A project mission is to deliver two pre-products and related applications and services. For each pre-product, the work is organized in three development cycles converging to the final release in a three-phase spiral approach. The results obtained from research will be utilized for the development of the pre-products. Each pre-product is developed on the basis of industry standards and architectures, including those developed by partners in the consortium. Since the early stages, the project will deliver partial prototypes for early validation of techniques and user requirements, including experiments with groups of users. At the end of each of the three basic project cycles, the prototypes will be installed and validated with a larger number of users in public events (international industry exhibits, artistic and music public performances, conferences and workshops). The demonstration of project results in public artistic events will also contribute to dissemination. The partners in the consortium already developed an internationally awarded concrete basis of consolidated research and technology which will be directly transferred into the project since it start-up. During the whole life cycle of the project, the presence of partners from research on expressiveness in music and dance, game and digital music instruments industry, VEs and visual media, sensor fabrics materials, will provide a cross-fertilisation and synergy as a fundamental concrete contribute to the originality of the pre-products definition and development. The Liaison Board of the project will be invited to participate to the public events and organised workshops in the project.

Milestones:
Three milestones at each conclusion of the three cycles of the spiral approach. Each milestone includes a version of the main scientific/technological product (MEGA System Environment) and a public demonstration/artistic event.
Milestone M1: initial prototype of the product and its experimenting in a small-scale public performance;
Milestone M2: second prototype of the product and a second public event;
Milestone M3: Final product and related applications and services, final validation and exploitation of results.

Leaflet | Map data © OpenStreetMap contributors, Credit: EC-GISCO, © EuroGeographics for the administrative boundaries

Coordinator

UNIVERSITA DEGLI STUDI DI GENOVA

Address

Via Balbi 5
16126 Genova

Italy

Administrative Contact

Antonio CAMURRI

Participants (8)

Sort alphabetically

Expand all

CONSORZIO PISA RICERCHE SCARL

Italy

EIDOMEDIA

Italy

GENERALMUSIC S.P.A.

Italy

KUNGLIGA TEKNISKA HOEGSKOLAN

Sweden

TELENOR COMMUNICATION AS

Norway

UNIVERSITA DEGLI STUDI DI PADOVA

Italy

UNIVERSITEIT GENT

Belgium

UPPSALA UNIVERSITET

Sweden

Project information

Grant agreement ID: IST-1999-20410

  • Start date

    1 November 2000

  • End date

    31 October 2003

Funded under:

FP5-IST

  • Overall budget:

    € 1 838 686

  • EU contribution

    € 1 138 000

Coordinated by:

UNIVERSITA DEGLI STUDI DI GENOVA

Italy