Skip to main content

Innovative revival of LIFE in ancient frescoS and creation of immerse narrative sPaces, featuring reaL scenes with behavioUr fauna and flora

Objective

Since antiquity, images were used as records of both events-lifestyles, as well as decorations. The possibility of reviving them would add a new dimension in understanding our past. Therefore, LIFEPLUS proposes new developments for the innovative revival of life in ancient frescos and creation of narrative spaces. The revival is based on real scenes captured on live video sequences augmented with real-time behaviour groups of 3D virtual fauna and flora. The metaphor, which will inspire the project approach, is oriented to make the "transportation in fictional and historical spaces", as uniquely depicted by frescos, as realistic, immerse and interactive as possible. The whole experience will be presented to the user on-site during his/her visit, through an immerse, mobile Augmented Reality-based Guide featuring wearable computing and multi-modal interaction.

Objectives:
LIFEPLUS proposes the innovative 3D reconstruction of ancient frescos through the real-time revival of their fauna and flora, featuring virtual animated characters with artificial life dramaturgical behaviours, in an immerse AR environment. In greater detail LIFEPLUS objectives are:
1) Real-time hyper realistic virtual life in AR environments;
2) Automatic Real-time Camera Tracking in unknown environments;
3) Perceptual issues in Augmented Reality (Occlusions, Shadow cues);
4) Design of successful character based installations;
5) Expressive autonomous cinematography for interactive Virtual Environments.
Although initially targeted at cultural heritage centres, the paradigm is not limited to those, but encompasses future location-based entertainments, e-visitor attractions and on-set visualisations for the TV/movie industry.

Work description:
The goal of LIFEPLUS is to push the limits of current Augmented Reality (AR) technologies, exploring the processes of narrative design of fictional spaces (e.g. frescos) where users can experience a high degree of realistic interactive immersion. Based on a captured/real-time video of a real scene, the project is oriented in enhancing these scenes by allowing the possibility to render realistic 3D simulations of virtual flora and fauna (humans, animals and plants) in real-time. According to its key technology, visitors are provided with a see-through Head-Mounted-Display (HMD), earphone and mobile computing equipment. A tracking system determines their location within the site and audio-visual information is presented to them in context with their exploration, superimposed on their current view of the site. LIFEPLUS will extend that system and provide key new technologies to render lively, real-time animations and simulations of ancient virtual life (3D human crowds, animals and plants). By its very nature, LIFEPLUS is a highly interdisciplinary project involving computer vision, computer graphics, user interfaces, human factors, wearable computing, mobile computing, computer networks, distributed computing, information access and information visualization. Two case study applications on virtual heritage will be developed and demonstrated. Historical world-class frescos will be "brought to life", through lively 3D animated revival of their content, superimposed on their real environment. Thus the ancient characters of the frescoes (including humans, animals and plants) will be revived and simulated in real-time in 3D, exhibiting in a new innovative manner their unique aesthetic, dramaturgical and emotional elements.

Milestones:
M1 End of Project;
M2 Completion of the functional specifications;
M3 Completion of Preliminary Camera Tracking SDK;
M4 Finalised prototypes of Virtual Flora and Fauna simulation SDKs;
M5 Final Authoring Tools suite;
M6 Final Mobile On-Site AR Guide;
M7 Final Middleware prototype;
M8 Final Demonstrator.

Funding Scheme

CSC - Cost-sharing contracts

Coordinator

FOUNDATION FOR RESEARCH AND TECHNOLOGY HELLAS
Address
Vassilika Vouton
17671 Iraklio, Crete
Greece

Participants (10)

A & C 2000 S.R.L.
Italy
Address
Viale Castello Della Magliana 38
00148 Roma
BIONATICS
France
Address
40 Boulevard Des Arceaux
34000 Montpellier
ECOLE POLYTECHNIQUE FEDERALE DE LAUSANNE
Switzerland
Address
Ecublens
1015 Lausanne
FRAUNHOFER GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Germany
Address
Hansastrasse 27C
80686 Muenchen
INTRACOM S.A. HELLENIC TELECOMMUNICATIONS AND ELECTRONICS INDUSTRY
Greece
Address
Odos Markopoulou 19,5Km Ktirio B5 Mark X
19002 Peania - Attiki
NODNA GMBH
Germany
Address
Johannisstrasse 60
50668 Koeln
SOPRINTENDENZA ARCEOLOGICA DI POMPEI
Italy
Address
Via Villa Dei Misteri 2
80045 Pompei
UNIVERSITA DEGLI STUDI DI MILANO
Italy
Address
Via Festa Del Perdono 7
20122 Milano
UNIVERSITE DE GENEVE
Switzerland
Address
Rue Du General Dufour 24
1211 Geneve 4
VICON MOTION SYSTEMS LIMITED
United Kingdom
Address
14 Minns Business Park, West Way
OX2 0JB Oxford