Project description
Multimodal Interfaces
The main objective of DICIT is the integration of distant-talking voice interaction as a complementary modality to the use of remote control in interactive TV systems. Augmenting remote control devices with speech may provide a suitable means to greatly ease information navigation and search. In the given scenario the system will recognize commands spoken by multiple users, even in the presence of background noise and TV surround audio propagated in the environment. The final prototype, for accessing a set top box system and related services, will be able to handle English, German, and Italian languages.The most challenging and innovative technical issues addressed in DICIT are multi-channel acoustic echo cancellation, blind source separation, acoustic event classification, multiple speaker localization, distant-talking automatic speech recognition, mixed-initiative dialogue, and multi-modal integration. In particular, the main research efforts will focus on multi-channel front end processing for acoustic scene interpretation in noisy and reverberant environment, without any constraint in the distance between acoustic sources (e.g. the speakers) and microphones. Activities of crucial importance will also regard the design of robust dialogue strategies able to: exploit the above mentioned technologies in an effective way; integrate both spoken commands and remote control operations; manage knowledge and user requirements in an efficient way. Both the architecture and the technical components will be realized with the aim to make easier the portability of DICIT technologies to other domains: in particular multi-microphone front-end may be fruitfully re-used in other applicative areas as smart-home, surveillance, security, video-conferencing, surgery room, games, etc. To this purpose, a second scenario will be explored in a preliminary way in order to show a possible exploitation of the given microphone network and related technologies in the home surveillance
Fields of science
Call for proposal
FP6-2005-IST-5
See other projects for this call
Funding Scheme
STREP - Specific Targeted Research ProjectCoordinator
38050 Povo-Trento
Italy