This site has been archived on
You are here: CORDIS / IST web / Activities / 2005-2006 Work Programme

Find the most recent information on EU Funding activities in the field of Information and Communication Technologies (ICT) by visiting our ICT in FP7 website , which covers ICT in the 7 th Framework Programme (FP7) 2007 - 2013.

2005-2006 Work Programme

2.5.7 Multimodal Interfaces


To develop natural and easy to use interfaces that communicate intelligently via several modalities or with multilingual capabilities.


  1. Natural interaction between humans and the physical or virtual environment , through multimodal interfaces that are autonomous and capable of learning and adapting to user intentions and behaviour, in dynamically changing environments. They should feature unconstrained, robust and ergonomic interaction, recognise user reactions and respond to them intelligently and naturally. Such interfaces should include mechanisms for selecting cognitively sound combinations of interface modalities according to the user's preferences and context.

    This presupposes a systematic approach to experimentation in both the fusion of information related to different modalities and their channelling to multiple modalities, with due consideration of synchronisation problems. Special attention should be given to integrated and multidisciplinary interface systems design in order to ensure the coherence of the proposed solutions, as well as sensitivity to context and adaptivity.

    Instruments: IPs, STREPs

  2. Multilingual communication systems for unrestricted domains, including real-time understanding of spontaneous spoken and gesture input in specific task-oriented settings. Research should address novel learning paradigms, e.g. utilizing statistical methods and/or exploiting contextual information, human and linguistic knowledge in a more effective way than currently done. Portability of new languages taking advantage of methods and techniques developed for languages already covered is a further challenge to be addressed, e.g. in the context of new EU languages.

    Instruments: IPs, STREPs

Work on user modelling, system design, visual recognition and tracking, language understanding and spoken language translation is envisaged. Proof of concept is expected in application domains characterised by multiple user scenarios, including interfaces for home and nomadic environments, as well as interfaces for creativity and entertainment.

IPs are expected to address system-level objectives in natural interaction and multilingual communication. They may be supplemented by STREPs in focussed areas such as language understanding and spoken language translation.
Indicative budget:
IPs: 60%; STREPs: 40%.
Call information:
IST Call 5

« Previous | Next » | Table of Contents

Related links