Objective The main objective of this Integrated Project (IP) is to enable highly realistic multi-modal interactive immersion into virtual and augmented reality environments. Its focus will be on visual, haptic and auditive sensory components, while addressing an even broader range of human senses. Hand-based interaction will serve as a prototypical framework, but the multimodal feedback of all relevant information will be considered.Three driving scenarios will cover the full spectrum of problems arising when implementing interactive environments: manipulation of an object by a human; direct contact between persons e.g. during a handshake or social dancing; and object mediated collaboration between humans, like jointly carrying a heavy object. These targets can only been reached by a concerted action, unifying competences in cognitive neuroscience, in psychophysics and in technology development. The indispensable scientific fundament will be established by basic research looking for new insights into the psychophysical and neurological mechanisms underlying multimodal interaction.A novel, data-driven algorithmic paradigm will be investigated for the generation of sensory feedback. During a first recording stage all relevant data characterizing interaction are collected by multimodal sensing suites. The recorded data will be processed in order to convert the raw signals into abstract descriptors. This abstraction will not only enable to faithfully replay the interactive session using the collected data while replacing the real counterpart by a virtual one, but will provide the fundament for prediction schemes to create sensory feedback for interaction which never has been observed before. The resulting prototype systems will be systematically evaluated by novel measures of presence to be developed in the course of the project. The IP will lead directly to trend-setting applications in science, medical therapy, entertainment, training, and education with immense potential. Fields of science natural sciencesbiological sciencesneurobiologycognitive neurosciencenatural sciencescomputer and information sciencessoftwaresoftware applicationssimulation software Programme(s) FP6-IST - Information Society Technologies: thematic priority under the specific programme "Integrating and strengthening the European research area" (2002-2006). Topic(s) Data not available Call for proposal Data not available Funding Scheme IP - Integrated Project Coordinator TECHNISCHE UNIVERSITAET MUENCHEN Address See on map Links Website Opens in new window EU contribution € 0,00 Participants (9) Sort alphabetically Sort by EU Contribution Expand all Collapse all CENTRE NATIONAL DE LA RECHERCHE SCIENTIFIQUE France EU contribution € 0,00 Address 3, rue michel-ange Paris cedex 16 See on map EIDGENÖSSISCHE TECHNISCHE HOCHSCHULE ZÜRICH Switzerland EU contribution € 0,00 Address Raemistrasse 101 Zuerich See on map Links Website Opens in new window MAX PLANCK GESELLSCHAFT ZUR FOERDERUNG DER WISSENSCHAFTEN E.V. Germany EU contribution € 0,00 Address Hofgartenstrasse 8 Muenchen See on map Links Website Opens in new window TECHNION - ISRAEL INSTITUTE OF TECHNOLOGY Israel EU contribution € 0,00 Address Technion city Haifa See on map Links Website Opens in new window THE UNIVERSITY OF BIRMINGHAM United Kingdom EU contribution € 0,00 Address Edgbaston Birmingham See on map Links Website Opens in new window UNIVERSIDAD POLITECNICA DE MADRID Spain EU contribution € 0,00 Address Grupo de tratamiento de imágenes, e.t.s. ing. de telecomunicación, avenida ramiro de maeztu 7 28040 Madrid See on map Links Website Opens in new window UNIVERSITA DI PISA Italy EU contribution € 0,00 Address Lungarno pacinotti 43/44 Pisa See on map Links Website Opens in new window UNIVERSITAT POLITECNICA DE CATALUNYA EU contribution € 0,00 Address See on map Links Website Opens in new window UNIVERSITE D'EVRY-VAL D'ESSONNE France EU contribution € 0,00 Address Boulevard francois mitterand 23 91025 Evry See on map
