Skip to main content

Three-Dimensional Imaging System based on integral photography for precise simulation of 3d perception and enhancement of the telepresence effect

Objective

We intend to develop a 3D imaging system based on Integral Photography technique, consisting of a 3D display prototype and a 3D image capturing system prototype. The proposed 3D imaging system simulates precisely 3D perception and enhances the Telepresence effect. The technology underlying the proposed system involves our innovations in the field of advanced mathematical modelling, algorithms and software, and optical hardware. Psychophysical research in the field of 3D vision in humans will allow the development of basic requirements for natural perception of3D images and the corresponding adjustment of 3D display. Our innovations allow a complete analysis, synthesis, and optimisation of the integral photography scheme and super-fast rendering and processing of images, which leads to the possibility of real-time 3D applications contributing to the fields where the experience of presence is important (learning, entertainment, training, telemedicine).

We intend to develop a 3D imaging system based on Integral Photography technique, consisting of a 3D display prototype and a 3D image capturing system prototype. The proposed 3D imaging system simulates precisely 3D perception and enhances the Telepresence effect. The technology underlying the proposed system involves our innovations in the field of advanced mathematical modelling, algorithms and software, and optical hardware. Psychophysical research in the field of 3D vision in humans will allow the development of basic requirements for natural perception of3D images and the corresponding adjustment of 3D display. Our innovations allow a complete analysis, synthesis, and optimisation of the integral photography scheme and super-fast rendering and processing of images, which leads to the possibility of real-time 3D applications contributing to the fields where the experience of presence is important (learning, entertainment, training, telemedicine).

OBJECTIVES
The scientific and technological objectives of the project include: the creation of a basic working prototype of a 3D display system, able to generate true 3Dimages on the integral imaging system, which consists of a flat panel LCD display and micro lens array, with natural 3D perception, resolution and depth, comparable to the screen size; the development of a functional prototype of the 3D capturing system compatible with the functional prototype of 3D display; the psychophysical research in the field of 3D vision in humans in order to develop basic requirements for the realization of natural perception of reconstructed 3D images and enhancement of presence effect; the adjustment of technical parameters of the3D display to the requirements elaborated in psychophysical research and development of a final working prototype of the 3D display.

DESCRIPTION OF WORK
The work plan is broken down into 4 work packages (WPs) focusing on the interrelated development of 3D imaging part (3D display system, 3D model synthesis toolkit, and a spectrogram generation engine), development of 3D image capturing system, the improvement of 3D display through the development and implementation of basic requirements for the realization of natural perception of reconstructed 3D image(including psychophysical research in the field of 3D vision in humans, elaboration and implementation of the requirements in the final prototype of 3Ddisplay), and management and coordination of the project. The final deliverables result from more than one WP. The teams involved should collaborate intensively during all stages of the project.

WP1 will realize the basic 3D display system and a spectrogram generation engine, which allows displaying of real or artificial3D images with realistic and satisfactory resolution, real 3D depth and other important 3D perceptions, described in the section B3. WP2 will result in system for the real time capturing of 3D images. WP3 is directed to the improvement of 3D display through the development and implementation of basic requirements for the realization of natural perception of reconstructed 3D image. These requirements will match remarkable peculiarity of human vision system to enhance the presence effect for observer.

WP3 will result in the implementation of the requirements to natural perception of 3D images in the final prototype of3D display. This will be done through the adjustment of technical parameters of3D display in order to meet the requirements elaborated through psychophysical research in the field of general sensor chain of forming of representation of real 3D-environment and artificial 3D images in the human brain.

WP4 is devoted to the management and coordination of the project and to the elaboration of exploitation strategy.
We have developed a working prototype of a 3D display system, able to generate true 3D images on the integral imaging system, which consists of a flat panel LCD display and microlens array, with natural 3D perception, resolution and depth, comparable to the screen size. The prototype has the following parameters:
-Diagonal screen size 22.2 inches
-LCD panel resolution 202 dpi
-Depth of reconstructed 3D image 142 mm
-Viewing distance ~ 1000 mm
-Viewing angle 15 degrees
-Maximal transversal resolution 0.8 (mm)^-1.

We have developed a functional prototype of the 3D capturing system providing:
-Close-to-real-time capturing of the 3D image
-Processing and reconstruction of the captured image and elimination of the pseudoscopy effect
-Compatibility with the functional prototype of 3D display We have developed basic requirements for the realization of natural perception of reconstructed 3D images and enchancement of presence effect. These requirements have been developed through psychophysical research in the field of 3D vision in humans, including general sensor chain of forming of representations of real 3D-environment and artificial 3D images in the human brain. We have developed a final working prototype of both the 3D capturing system and the 3D display that matches remarkable peculiarity of human vision system in order to achieve better realization of full presence effect for the observer. This has been done by adjustment of technical parameters of the 3D display and capturing system to the requirements elaborated in psychophysical research.

Funding Scheme

CSC - Cost-sharing contracts

Coordinator

LES INSTITUTS INTERNATIONAUX DE PHYSIQUE ET DE CHIMIE, FONDES PAR ERNEST SOLVAY
Address
Avenue Franklin Roosevelt 50
1050 Bruxelles
Belgium

Participants (2)

NATIONAL AND KAPODISTRIAN UNIVERSITY OF ATHENS
Greece
Address
30 Panepistimiou Str.
10679 Athens
THE CHANCELLOR, MASTERS AND SCHOLARS OF THE UNIVERSITY OF OXFORD
United Kingdom
Address
University Offices, Wellington Square
OX1 2JD Oxford