Skip to main content
Go to the home page of the European Commission (opens in new window)
English en
CORDIS - EU research results
CORDIS
Content archived on 2024-06-18

Cross-Modal Perceptual Display: a New Generation of Audiovisual Virtual Environments

Project description


FET - Open

Virtual environments (VEs) play an increasingly important role in our society. Currently two main sensorial channels are exploited in VEs: visual and auditory, although sound is greatly underused. The ever-increasing scene complexity of VEs means that it is currently not possible to display highly realistic scenes in real time despite the availability of modern high-performance graphics and audio processors. However, the realism and quality of a virtual image/sound needs to be as good as what the user can perceive: we only need to display what is necessary. Despite recent research, little work exists on cross-modal effects, i.e. the effects that each channel (visual and auditory) has on the other, to improve the efficiency and quality of VEs. CROSSMOD will study these effects and develop a better understanding of how perceptual issues affect auditory/visual display; this understanding will lead to the development of novel algorithms for selectively rendering VEs. The cross-modal effects studied will potentially include the effect of spatial/latency congruence on quality perception, attention-control, sound-induced changes in visual perception and foveal/peripheral audiovisual effects. These initial experiments will be guided by their applicability to the improvement of VE display and authoring. An integrated cross-modal manager will be developed, using results of the initial experiments identifying which cross-modal effects are useful for VE display. The solutions developed by CROSSMOD will enable the display of perceptually highly realistic environments in real time even for very complex scenes, as well as the use of active cross-modal effects such as attention control in the display and authoring of VEs. We will evaluate our hypotheses with further experiments in realistic, complex VEs. Further evaluation will be performed on three target applications: computer games, design/architecture and clinical psychiatry, using platforms adapted to each application.

Fields of science (EuroSciVoc)

CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: The European Science Vocabulary.

You need to log in or register to use this function

Topic(s)

Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.

Call for proposal

Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.

FP6-2002-IST-C
See other projects for this call

Funding Scheme

Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.

STREP - Specific Targeted Research Project

Coordinator

INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET EN AUTOMATIQUE
EU contribution
€ 387 785,00
Address
2004, route de Lucioles
F-06902 Sophia-Antipolis
France

See on map

Total cost

The total costs incurred by this organisation to participate in the project, including direct and indirect costs. This amount is a subset of the overall project budget.

No data

Participants (6)

My booklet 0 0