Objective
The main objective of this Integrated Project (IP) is to enable highly realistic multi-modal interactive immersion into virtual and augmented reality environments. Its focus will be on visual, haptic and auditive sensory components, while addressing an even broader range of human senses. Hand-based interaction will serve as a prototypical framework, but the multimodal feedback of all relevant information will be considered.
Three driving scenarios will cover the full spectrum of problems arising when implementing interactive environments: manipulation of an object by a human; direct contact between persons e.g. during a handshake or social dancing; and object mediated collaboration between humans, like jointly carrying a heavy object. These targets can only been reached by a concerted action, unifying competences in cognitive neuroscience, in psychophysics and in technology development. The indispensable scientific fundament will be established by basic research looking for new insights into the psychophysical and neurological mechanisms underlying multimodal interaction.
A novel, data-driven algorithmic paradigm will be investigated for the generation of sensory feedback. During a first recording stage all relevant data characterizing interaction are collected by multimodal sensing suites. The recorded data will be processed in order to convert the raw signals into abstract descriptors. This abstraction will not only enable to faithfully replay the interactive session using the collected data while replacing the real counterpart by a virtual one, but will provide the fundament for prediction schemes to create sensory feedback for interaction which never has been observed before. The resulting prototype systems will be systematically evaluated by novel measures of presence to be developed in the course of the project. The IP will lead directly to trend-setting applications in science, medical therapy, entertainment, training, and education with immense potential.
Fields of science (EuroSciVoc)
CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: The European Science Vocabulary.
CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: The European Science Vocabulary.
- natural sciences biological sciences neurobiology cognitive neuroscience
- natural sciences computer and information sciences software software applications simulation software
You need to log in or register to use this function
Programme(s)
Multi-annual funding programmes that define the EU’s priorities for research and innovation.
Multi-annual funding programmes that define the EU’s priorities for research and innovation.
Topic(s)
Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.
Data not available
Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.
Call for proposal
Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.
Data not available
Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.
Funding Scheme
Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.
Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.
Coordinator
The total costs incurred by this organisation to participate in the project, including direct and indirect costs. This amount is a subset of the overall project budget.