Skip to main content

Markerless Real-time Tracking for Augmented Reality Image Synthesis

Project description

Multimodal interfaces

Augmented reality (AR) is a growing field, with many diverseapplications ranging from TV and film production, to industrialmaintenance, medicine, education, entertainment and games. The centralidea is to add virtual objects into a real scene, either by displayingthem in a see-through head-mounted display, or by superimposing them onan image of the scene captured by a camera. Depending on theapplication, the added objects might be virtual characters in a TV orfilm production, instructions for repairing a car engine, or areconstruction of an archaeological site (see Figure below).

For the effect to be believable, the virtual objects must appearrigidly fixed to the real world, which requires the accuratemeasurement in real-time of the position of the camera or the user'shead. Present technology cannot achieve this without resorting tosystems that require a significant infrastructure in the operatingenvironment, severely restricting the range of possible applications.

The objective of MATRIS is to develop and implement a system fordetermining the position, orientation, and focal length of a camera inreal time, by analysis of the camera images and exploitation ofunobtrusive inertial motion sensors. As the system will not requiremarkers or other special infrastructure in the environment, it will besuitable for applications where existing tracking systems cannot easilybe used, including:

insertionof virtual objects in live broadcast images outside of a dedicated"virtual studio" environment, such as graphics for sport, or virtualobjects in a conventional TV studio
augmented reality applications in the area of development, production, service and maintenance
augmented reality for architecture, design and product presentation
augmented reality for cultural heritage sites and tourism

Call for proposal

FP6-2002-IST-1
See other projects for this call

Funding Scheme

STREP - Specific Targeted Research Project

Coordinator

FRAUNHOFER GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Address
Fraunhoferstrasse 5
64283 Darmstadt
Germany
EU contribution
€ 829 176,22

Participants (4)

CHRISTIAN-ALBRECHTS-UNIVERSITAET ZU KIEL
Germany
EU contribution
€ 473 851,61
Address
Olshausenstrasse 40
24098 Kiel
Activity type
Higher or Secondary Education Establishments
Xsens Technologies B.V.
Netherlands
EU contribution
€ 152 724,58
Address
Hengelosestraat 705
7521 PA Enschede
LINKOEPINGS UNIVERSITET
Sweden
EU contribution
€ 535 256,35
Address
Campus Valla
581 83 Linkoeping
BRITISH BROADCASTING CORPORATION
United Kingdom
EU contribution
€ 408 990,46
Address
Broadcasting House
W1A 1AA London