Skip to main content
Go to the home page of the European Commission (opens in new window)
English en
CORDIS - EU research results
CORDIS
Content archived on 2024-05-29

3D and Speech Interfacing Technologies

Project description


Multimodal Interfaces

INTERACT will use all three senses: vision, speech and touch, with the aim to overcome existing limitations in the way information is presented and interacted with in the new generation of computer platforms. The emphasis will be placed on 3D information visualization and manipulation based on the fusion of three core technologies: Holographic Displays, Computer Vision based 3D Hands Tracker and Natural Speech Processing. The Holographic Displays will provide, highly realistic, naked eyed, representations of 3D information to multiple simultaneous users, each viewing a different perspective. 3D objects may appear floating behind or in front of the display and users will be able to walk around the screen in a wide field of view seeing objects and shadows moving continuously as in the normal perspective without causing strain to the user. The Hands Tracker will use advanced computer vision techniques to achieve accurate detection of the movements of the hands and fingers of the user in the 3D space with the aim of precise manipulation of virtual objects and advanced gesture interpretation. Finally, the Speech Interface will allow intelligent dialogue exchange with the machine using plain words.The project will produce an advanced information access point where the three mentioned interfacing technologies will be fully integrated for unprecedented levels of realism and interactivity. Within the system virtual representations will be displayed realistically in true 3D and the user will be able to shape or manipulate the virtual objects in real time using his own hands, while he issues gesture commands or dialogues with the context aware natural speech interface for more complex interaction requests with the machine. The new technology will be aimed at either home or professional applications since both the display and the input technologies will be achieved naked eyed and no uncomfortable devices, such as markers, wearable devices or cabling, will be required.

Fields of science (EuroSciVoc)

CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: The European Science Vocabulary.

You need to log in or register to use this function

Topic(s)

Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.

Call for proposal

Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.

FP6-2005-IST-5
See other projects for this call

Funding Scheme

Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.

STREP - Specific Targeted Research Project

Coordinator

INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET EN AUTOMATIQUE
EU contribution
€ 407 300,00
Address
Inovallée - 655 Avenue de l'Europe - Montbonnot Saint Mart 655
38334 Saint Ismier
France

See on map

Total cost

The total costs incurred by this organisation to participate in the project, including direct and indirect costs. This amount is a subset of the overall project budget.

No data

Participants (4)

My booklet 0 0