Objective The goal of this project is the mathematical investigation of smoothness and self-similarity principles in generating natural images, the mathematical formulation and unification of both ideas in a variational form, and its application to develop models and algorithms for image processing tasks.The proposed research will lead to the formulation and mathematical analysis of new variational principles for image and movie processing, the analysis of their underlying geometric measure theory and partial differential equations, unifying local and nonlocal approaches as respective mathematical expressions of the ideas of regularity and self-similarity. Our research will be guided by a thorough investigation of the inpainting problem (including images, video and stereo video inpainting), as a very suitable model for testing the proposed ideas.The first practical impact will be the development of models and algorithms for 2D and 3D image and video editing and manipulation, enabling the deletion and insertion of objects. As a second impact we will provide the theoretical background and implementation of a set of algorithms for 2D to 3D conversion of video data enabling the generation of 3D content for 3D TV from existing 2D video. Due to its fundamental nature, the proposed models may impact other image and video processing areas such as denoising, restoration, optical flow computation, or stereo, that share similar challenges. Although their study is not in the scope of this project, it will be fostered by the dissemination of our results and the public release of our algorithms.The PI has a long experience in the variational formulation of image processing problems, with key contributions in the variational formulations of edge detection and image inpainting, mathematical morphology, and the analysis of Total Variation based models. On the practical side, he has been contributing to the development of video post-production tools in several projects led by industry. Fields of science humanitiesartsmodern and contemporary artcinematographynatural sciencesmathematicspure mathematicsmathematical analysisdifferential equationspartial differential equations Programme(s) FP7-IDEAS-ERC - Specific programme: "Ideas" implementing the Seventh Framework Programme of the European Community for research, technological development and demonstration activities (2007 to 2013) Topic(s) ERC-AG-PE1 - ERC Advanced Grant - Mathematical foundations Call for proposal ERC-2012-ADG_20120216 See other projects for this call Funding Scheme ERC-AG - ERC Advanced Grant Host institution UNIVERSIDAD POMPEU FABRA EU contribution € 515 054,69 Address PLACA DE LA MERCE, 10-12 08002 Barcelona Spain See on map Region Este Cataluña Barcelona Activity type Higher or Secondary Education Establishments Principal investigator Vicent Caselles Costa (Prof.) Administrative Contact Eva Martin (Ms.) Links Contact the organisation Opens in new window Website Opens in new window Total cost No data Beneficiaries (1) Sort alphabetically Sort by EU Contribution Expand all Collapse all UNIVERSIDAD POMPEU FABRA Spain EU contribution € 515 054,69 Address PLACA DE LA MERCE, 10-12 08002 Barcelona See on map Region Este Cataluña Barcelona Activity type Higher or Secondary Education Establishments Principal investigator Vicent Caselles Costa (Prof.) Administrative Contact Eva Martin (Ms.) Links Contact the organisation Opens in new window Website Opens in new window Total cost No data