Skip to main content
European Commission logo
italiano italiano
CORDIS - Risultati della ricerca dell’UE
CORDIS
CORDIS Web 30th anniversary CORDIS Web 30th anniversary
Contenuto archiviato il 2024-05-27

LEarning from our collective visual memory to Analyze its trends and Predict future events

Obiettivo

People constantly draw on past visual experiences to anticipate future events and better understand, navigate, and interact with their environment, for example, when seeing an angry dog or a quickly approaching car. Currently there is no artificial system with a similar level of visual analysis and prediction capabilities. LEAP is a first step in that direction, leveraging the emerging collective visual memory formed by the unprecedented amount of visual data available in public archives, on the Internet and from surveillance or personal cameras - a complex evolving net of dynamic scenes, distributed across many different data sources, and equipped with plentiful but noisy and incomplete metadata. The goal of this project is to analyze dynamic patterns in this shared visual experience in order (i) to find and quantify their trends; and (ii) learn to predict future events in dynamic scenes.
With ever expanding computational resources and this extraordinary data, the main scientific challenge is now to invent new and powerful models adapted to its scale and its spatio-temporal, distributed and dynamic nature. To address this challenge, we will first design new models that generalize across different data sources, where scenes are captured under vastly different imaging conditions. Next, we will develop a framework for finding, describing and quantifying trends that involve measuring long-term changes in many related scenes. Finally, we will develop a methodology and tools for synthesizing complex future predictions from aligned past visual experiences.
Breakthrough progress on these problems would have profound implications on our everyday lives as well as science and commerce, with safer cars that anticipate the behavior of pedestrians on streets; tools that help doctors monitor, diagnose and predict patients’ health; and smart glasses that help people react in unfamiliar situations enabled by the advances from this project.

Invito a presentare proposte

ERC-2013-StG
Vedi altri progetti per questo bando

Meccanismo di finanziamento

ERC-SG - ERC Starting Grant

Istituzione ospitante

INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET AUTOMATIQUE
Contributo UE
€ 1 496 736,00
Indirizzo
DOMAINE DE VOLUCEAU ROCQUENCOURT
78153 Le Chesnay Cedex
Francia

Mostra sulla mappa

Regione
Ile-de-France Ile-de-France Yvelines
Tipo di attività
Research Organisations
Contatto amministrativo
Jacqueline Maestracci (Ms.)
Ricercatore principale
Josef Sivic (Dr.)
Collegamenti
Costo totale
Nessun dato

Beneficiari (1)