Skip to main content
European Commission logo print header

3D and Speech Interfacing Technologies

Description du projet


Multimodal Interfaces

INTERACT will use all three senses: vision, speech and touch, with the aim to overcome existing limitations in the way information is presented and interacted with in the new generation of computer platforms. The emphasis will be placed on 3D information visualization and manipulation based on the fusion of three core technologies: Holographic Displays, Computer Vision based 3D Hands Tracker and Natural Speech Processing. The Holographic Displays will provide, highly realistic, naked eyed, representations of 3D information to multiple simultaneous users, each viewing a different perspective. 3D objects may appear floating behind or in front of the display and users will be able to walk around the screen in a wide field of view seeing objects and shadows moving continuously as in the normal perspective without causing strain to the user. The Hands Tracker will use advanced computer vision techniques to achieve accurate detection of the movements of the hands and fingers of the user in the 3D space with the aim of precise manipulation of virtual objects and advanced gesture interpretation. Finally, the Speech Interface will allow intelligent dialogue exchange with the machine using plain words.The project will produce an advanced information access point where the three mentioned interfacing technologies will be fully integrated for unprecedented levels of realism and interactivity. Within the system virtual representations will be displayed realistically in true 3D and the user will be able to shape or manipulate the virtual objects in real time using his own hands, while he issues gesture commands or dialogues with the context aware natural speech interface for more complex interaction requests with the machine. The new technology will be aimed at either home or professional applications since both the display and the input technologies will be achieved naked eyed and no uncomfortable devices, such as markers, wearable devices or cabling, will be required.

Appel à propositions

FP6-2005-IST-5
Voir d’autres projets de cet appel

Coordinateur

INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET EN AUTOMATIQUE
Contribution de l’UE
€ 407 300,00
Adresse
Inovallée - 655 Avenue de l'Europe - Montbonnot Saint Mart 655
38334 Saint Ismier
France

Voir sur la carte

Coût total
Aucune donnée

Participants (4)