Objective People constantly draw on past visual experiences to anticipate future events and better understand, navigate, and interact with their environment, for example, when seeing an angry dog or a quickly approaching car. Currently there is no artificial system with a similar level of visual analysis and prediction capabilities. LEAP is a first step in that direction, leveraging the emerging collective visual memory formed by the unprecedented amount of visual data available in public archives, on the Internet and from surveillance or personal cameras - a complex evolving net of dynamic scenes, distributed across many different data sources, and equipped with plentiful but noisy and incomplete metadata. The goal of this project is to analyze dynamic patterns in this shared visual experience in order (i) to find and quantify their trends; and (ii) learn to predict future events in dynamic scenes.With ever expanding computational resources and this extraordinary data, the main scientific challenge is now to invent new and powerful models adapted to its scale and its spatio-temporal, distributed and dynamic nature. To address this challenge, we will first design new models that generalize across different data sources, where scenes are captured under vastly different imaging conditions. Next, we will develop a framework for finding, describing and quantifying trends that involve measuring long-term changes in many related scenes. Finally, we will develop a methodology and tools for synthesizing complex future predictions from aligned past visual experiences.Breakthrough progress on these problems would have profound implications on our everyday lives as well as science and commerce, with safer cars that anticipate the behavior of pedestrians on streets; tools that help doctors monitor, diagnose and predict patients’ health; and smart glasses that help people react in unfamiliar situations enabled by the advances from this project. Fields of science natural sciencescomputer and information sciencesinternetengineering and technologyelectrical engineering, electronic engineering, information engineeringelectronic engineeringsensorsoptical sensorsagricultural sciencesanimal and dairy sciencedomestic animalsengineering and technologymaterials engineeringsocial scienceseconomics and businessbusiness and managementcommerce Programme(s) FP7-IDEAS-ERC - Specific programme: "Ideas" implementing the Seventh Framework Programme of the European Community for research, technological development and demonstration activities (2007 to 2013) Topic(s) ERC-SG-PE6 - ERC Starting Grant - Computer science and informatics Call for proposal ERC-2013-StG See other projects for this call Funding Scheme ERC-SG - ERC Starting Grant Coordinator INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET AUTOMATIQUE Address Domaine de voluceau rocquencourt 78153 Le chesnay cedex France See on map Region Ile-de-France Ile-de-France Yvelines Activity type Research Organisations Administrative Contact Jacqueline Maestracci (Ms.) Principal investigator Josef Sivic (Dr.) Links Contact the organisation Opens in new window Website Opens in new window EU contribution € 1 496 736,00 Beneficiaries (1) Sort alphabetically Sort by EU Contribution Expand all Collapse all INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET AUTOMATIQUE France EU contribution € 1 496 736,00 Address Domaine de voluceau rocquencourt 78153 Le chesnay cedex See on map Region Ile-de-France Ile-de-France Yvelines Activity type Research Organisations Administrative Contact Jacqueline Maestracci (Ms.) Principal investigator Josef Sivic (Dr.) Links Contact the organisation Opens in new window Website Opens in new window
