Skip to main content
Go to the home page of the European Commission (opens in new window)
English English
CORDIS - EU research results
CORDIS
Content archived on 2024-05-27

Multisensory Expressive Gesture Applications

Objective

The project is centred on the modelling and real-time analysis, synthesis, and networked communication of expressive and emotional content in non-verbal interaction by multi-sensory interfaces, from a multi-modal perspective. Music (incl. singing voice) and movement (incl. dance) are first class channels for conveying expressive and emotional content. A project mission is to deliver products and related applications and services: for each product, the work is organized in three development cycles converging to the final release in a three-phase spiral approach. Each product is developed on the basis of industry standards and architectures, including those developed by partners in the consortium. Since the early stages, the project will deliver working prototypes for early validation, experiments with groups of users. At the end of each of the three basic project cycles, the prototypes will be installed and validated with a larger number of users in public events (e.g. exhibit, artistic and music performance, workshops). The demonstration of project results in public events will also contribute to dissemination. The partners in the consortium already developed an internationally awarded concrete basis of consolidated research and technology which will be directly transferable into the project at its startup.

Objectives:
Strategic and economical objectives include:
(i) consolidation of a European route original in both cultural and scientific content with respect to Affective Computing (USA) and KANSEI Information Processing (Japan);
(ii) dramatic raising of the competitiveness of European Industry of Digital Music Instruments (suffering from the aggressive Japan and USA industry), of Entertainment and Multimedia Industry.

Work description:
The project is centred on the modelling and real-time analysis, synthesis, and networked communication of expressive and emotional content in non-verbal interaction by multi-sensory interfaces, from a multi-modal perspective. Music (including singing voice) and movement (including dance) are first class channels for conveying expressive and emotional content. A project mission is to deliver two pre-products and related applications and services. For each pre-product, the work is organized in three development cycles converging to the final release in a three-phase spiral approach. The results obtained from research will be utilized for the development of the pre-products. Each pre-product is developed on the basis of industry standards and architectures, including those developed by partners in the consortium. Since the early stages, the project will deliver partial prototypes for early validation of techniques and user requirements, including experiments with groups of users. At the end of each of the three basic project cycles, the prototypes will be installed and validated with a larger number of users in public events (international industry exhibits, artistic and music public performances, conferences and workshops). The demonstration of project results in public artistic events will also contribute to dissemination. The partners in the consortium already developed an internationally awarded concrete basis of consolidated research and technology which will be directly transferred into the project since it start-up. During the whole life cycle of the project, the presence of partners from research on expressiveness in music and dance, game and digital music instruments industry, VEs and visual media, sensor fabrics materials, will provide a cross-fertilisation and synergy as a fundamental concrete contribute to the originality of the pre-products definition and development. The Liaison Board of the project will be invited to participate to the public events and organised workshops in the project.

Milestones:
Three milestones at each conclusion of the three cycles of the spiral approach. Each milestone includes a version of the main scientific/technological product (MEGA System Environment) and a public demonstration/artistic event.
Milestone M1: initial prototype of the product and its experimenting in a small-scale public performance;
Milestone M2: second prototype of the product and a second public event;
Milestone M3: Final product and related applications and services, final validation and exploitation of results.

Fields of science (EuroSciVoc)

CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: The European Science Vocabulary.

You need to log in or register to use this function

Programme(s)

Multi-annual funding programmes that define the EU’s priorities for research and innovation.

Topic(s)

Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.

Call for proposal

Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.

Data not available

Funding Scheme

Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.

CSC - Cost-sharing contracts

Coordinator

UNIVERSITA DEGLI STUDI DI GENOVA
EU contribution
No data
Address
VIA BALBI 5
16126 GENOVA
Italy

See on map

Total cost

The total costs incurred by this organisation to participate in the project, including direct and indirect costs. This amount is a subset of the overall project budget.

No data

Participants (8)

My booklet 0 0