Skip to main content

Enhanced Reality For The Video

Objective

The ENREVI project proposes new development for the enhancement of a video sequence captured on a real scene with real-time rendered 3D objects. Emphasis is put both on real time and on economically affordable solutions. Research and development objectives include: Fundamental research will provide tools for tracking in unknown environment. Software real time engine that could render 3D synthetic image on affordable hardware platform. Format to generate, store and retrieve data in accordance with existing and future standards. New generation of chroma key product, software configurable. Integration of all different modules in a real life environment, under the specification and control of the end-user.

Objectives:
The ENREVI project proposes new development for the enhancement of real time video of real scene with real-time render 3D objects. Emphasis is put on economically affordable solutions.

This generic technology will open a wide range of applications were Virtual object need to be merged into the real scene:
* For a better understanding of action on television,
* For aesthetics and creative additions on Tv programs,
* For environmental impact analysis,
* For Pre-visualisation of Cad/cam result in natural environment,
* For Pre-visualisation of special effects in the movie industry,
* For future Internet and Interactive television applications,
* Some application in training and in medical imaging can also be considered.

Work description:
The ENREVI consortium plan to focus on the following points:

1) Fundamental research will provide tools for tracking in unknown environment in real time. It includes: Hyper tracking system, feature system and tracking system and exploration of tracking without markers in arbitrary environment.
These tracking solutions should be compatible with operational conditions and combination of sensor based and image based method will be investigated for a real time 3D tracking.

2) A software real time engine will e developed that could render 3D synthetic image on an hardware platform with a target price 10.000 EURO. The 3D rendering engine will be based on databases compatibles with the 3D design industry standards. It will also deliver broadcast quality graphics in particular in the anti-aliasing process and allow seamless mix with the video image. PC environment is a must.

3) Analysis of MPEG, DVB and Video Internet standards to specify format to generate, store, retrieve in accordance with existing and future standards. This format should allow frame synchronisation and frame variable position of inserted object.

4) A new generation of chroma key product, software configurable, which will include: algorithmic auto set-up, setting associated to a portion of the image, settings adjustable in real time by external date, selective softness dependent of picture content.

5) Integration of all different modules in real life environment: after co-ordination of specification taking into account users requirement, GUI will be developed, tracking solutions will be validated and ported to real time industrial environment, communication between modules will be checked and a minimum of two demos in two different environments will be organised under users specifications.

First Milestone is in month 8 with system specifications, triggering subsystem specifications.

Next milestones are deliveries of three subsystems:
* 3D Real time rendering prototype in month 15,
* Keying subsystem Prototype in month 15,
* Tracking subsystem Prototype in month 18.

Milestones:
First Milestone is in month 8 with system specifications, triggering subsystem specifications.

Next milestones are deliveries of three subsystems:
* 3D Real time rendering prototype in month 15,
* Keying subsystem Prototype in month 15,
* Tracking subsystem Prototype in month 18.

Call for proposal

Data not available

Coordinator

SYMAH VISION
Address
27, Rue Jean Bleuzen
92170 Vanves
France

Participants (2)

CRYSTAL VISION LIMITED
United Kingdom
Address
Vine Close 17
CB2 5BZ Stapleford, Cambridgeshire
 
FRAUNHOFER GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Germany
Address
Hansastrasse 27C
80686 Muenchen