Skip to main content
European Commission logo print header

Inpainting Tools for Video Post-production: Variational theory and fast algorithms

Objective

The goal of this project is the mathematical investigation of smoothness and self-similarity principles in generating natural images, the mathematical formulation and unification of both ideas in a variational form, and its application to develop models and algorithms for image processing tasks.
The proposed research will lead to the formulation and mathematical analysis of new variational principles for image and movie processing, the analysis of their underlying geometric measure theory and partial differential equations, unifying local and nonlocal approaches as respective mathematical expressions of the ideas of regularity and self-similarity. Our research will be guided by a thorough investigation of the inpainting problem (including images, video and stereo video inpainting), as a very suitable model for testing the proposed ideas.
The first practical impact will be the development of models and algorithms for 2D and 3D image and video editing and manipulation, enabling the deletion and insertion of objects. As a second impact we will provide the theoretical background and implementation of a set of algorithms for 2D to 3D conversion of video data enabling the generation of 3D content for 3D TV from existing 2D video. Due to its fundamental nature, the proposed models may impact other image and video processing areas such as denoising, restoration, optical flow computation, or stereo, that share similar challenges. Although their study is not in the scope of this project, it will be fostered by the dissemination of our results and the public release of our algorithms.
The PI has a long experience in the variational formulation of image processing problems, with key contributions in the variational formulations of edge detection and image inpainting, mathematical morphology, and the analysis of Total Variation based models. On the practical side, he has been contributing to the development of video post-production tools in several projects led by industry.

Call for proposal

ERC-2012-ADG_20120216
See other projects for this call

Host institution

UNIVERSIDAD POMPEU FABRA
EU contribution
€ 515 054,69
Address
PLACA DE LA MERCE, 10-12
08002 Barcelona
Spain

See on map

Region
Este Cataluña Barcelona
Activity type
Higher or Secondary Education Establishments
Principal investigator
Vicent Caselles Costa (Prof.)
Administrative Contact
Eva Martin (Ms.)
Links
Total cost
No data

Beneficiaries (1)