Community Research and Development Information Service - CORDIS

FP6 logo matris

MATRIS

Project ID: 002013
Funded under

Markerless Real-time Tracking for Augmented Reality Image Synthesis

From 2004-02-01 to 2007-01-31, closed project | MATRIS Website

Project details

Total cost:

EUR 3 603 662,04

EU contribution:

EUR 2 399 999,22

Coordinated in:

Germany

Call for proposal:

FP6-2002-IST-1See other projects for this call

Funding scheme:

STREP - Specific Targeted Research Project

Description

Augmented reality (AR) is a growing field, with many diverseapplications ranging from TV and film production, to industrialmaintenance, medicine, education, entertainment and games. The centralidea is to add virtual objects into a real scene, either by displayingthem in a see-through head-mounted display, or by superimposing them onan image of the scene captured by a camera. Depending on theapplication, the added objects might be virtual characters in a TV orfilm production, instructions for repairing a car engine, or areconstruction of an archaeological site (see Figure below).

For the effect to be believable, the virtual objects must appearrigidly fixed to the real world, which requires the accuratemeasurement in real-time of the position of the camera or the user'shead. Present technology cannot achieve this without resorting tosystems that require a significant infrastructure in the operatingenvironment, severely restricting the range of possible applications.

The objective of MATRIS is to develop and implement a system fordetermining the position, orientation, and focal length of a camera inreal time, by analysis of the camera images and exploitation ofunobtrusive inertial motion sensors. As the system will not requiremarkers or other special infrastructure in the environment, it will besuitable for applications where existing tracking systems cannot easilybe used, including:

insertionof virtual objects in live broadcast images outside of a dedicated"virtual studio" environment, such as graphics for sport, or virtualobjects in a conventional TV studio
augmented reality applications in the area of development, production, service and maintenance
augmented reality for architecture, design and product presentation
augmented reality for cultural heritage sites and tourism

Objective

There are many applications in which it is necessary to overlay a computer-generated object onto a real scene in real-time, requiring accurate measurement of the position of the camera or headset. Existing methods require bulky hardware, severely limiting their usability. The objective of this project is to develop and implement a system for determining the position, orientation, and focal length of a camera in real-time, by analysis of the camera images and exploitation of unobtrusive inertial motion sensors. This will enable the system as a whole to determine its location and orientation in a very natural way, mimicking the way a human orients himself, using the vestibular organ (in the ears) � which is essentially an inertial measurement unit, and the eyes � essentially comparable to a camera. The results of project will be a marker-free tracking system that works with a high frame-rate on a low-performance computer unit. It will allow the capture of camera and head motions respectively for TV production and mobile augmented reality applications. In particular the system will work over a large area in indoor as well as in outdoor environments. By providing this unique technology, the project will act as a strong enabling force for the wider deployment of augmented reality in application areas including content production, education, cultural heritage and industry.

Coordinator

FRAUNHOFER GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Germany

EU contribution: EUR 829 176,22


Fraunhoferstrasse 5
64283 Darmstadt
Germany
Activity type:
Administrative contact: Didier Stricker
Tel.: +49-6151-155188
Fax: +49-6151-155196
E-mail

Participants

CHRISTIAN-ALBRECHTS-UNIVERSITAET ZU KIEL
Germany

EU contribution: EUR 473 851,61


OLSHAUSENSTRASSE 40
24098 KIEL
Germany
Activity type: Higher or Secondary Education Establishments
Administrative contact: Reinhard Koch
Tel.: +49-431-8804484
Fax: +49-431-8804474
E-mail
Xsens Technologies B.V.
Netherlands

EU contribution: EUR 152 724,58


HENGELOSESTRAAT 705
7521 PA ENSCHEDE
Netherlands
Activity type:
Administrative contact: Per Slycke
Tel.: +31-53-4836444
Fax: +31-53-4836445
E-mail
LINKOEPINGS UNIVERSITET
Sweden

EU contribution: EUR 535 256,35


CAMPUS VALLA
581 83 LINKOEPING
Sweden
Activity type:
Administrative contact: Lars Nielsen
Tel.: +46 13 281307
Fax: +46 13 289282
E-mail
BRITISH BROADCASTING CORPORATION
United Kingdom

EU contribution: EUR 408 990,46


BROADCASTING HOUSE
W1A 1AA LONDON
United Kingdom
Activity type:
Administrative contact: Graham Thomas
Tel.: +44-1737-839643
Fax: +44-1737-839665
E-mail
Follow us on: RSS Facebook Twitter YouTube Managed by the EU Publications Office Top