Visual Recognition of Function and Intention

Objetivo

"Computer vision is concerned with the automated interpretation of images and video streams. Today's research is (mostly) aimed at answering queries such as ""Is this a picture of a dog?"", (classification) or sometimes ""Find the dog in this photo"" (detection). While categorisation and detection are useful for many tasks, inferring correct class labels is not the final answer to visual recognition. The categories and locations of objects do not provide direct understanding of their function i.e. how things work, what they can be used for, or how they can act and react. Such an understanding, however, would be highly desirable to answer currently unsolvable queries such as ""Am I in danger?"" or ""What can happen in this scene?"". Solving such queries is the aim of this proposal.

My goal is to uncover the functional properties of objects and the purpose of actions by addressing visual recognition from a different and yet unexplored perspective. The main novelty of this proposal is to leverage observations of people, i.e. their actions and interactions to automatically learn the use, the purpose and the function of objects and scenes from visual data. The project is timely as it builds upon the two key recent technological advances: (a) the immense progress in visual recognition of objects, scenes and human actions achieved in the last ten years, as well as (b) the emergence of a massive amount of public image and video data now available to train visual models.

ACTIVIA addresses fundamental research issues in automated interpretation of dynamic visual scenes, but its results are expected to serve as a basis for ground-breaking technological advances in practical applications. The recognition of functional properties and intentions as explored in this project will directly support high-impact applications such as detection of abnormal events, which are likely to revolutionise today's approaches to crime protection, hazard prevention, elderly care, and many others."

Ámbito científico

Régimen de financiación

ERC-SG - ERC Starting Grant

Institución de acogida

INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET AUTOMATIQUE

Aportación de la UE

€ 1 497 420,00

Dirección

DOMAINE DE VOLUCEAU ROCQUENCOURT
78153 Le Chesnay Cedex
Francia

Región

Ile-de-France Ile-de-France Yvelines

Tipo de actividad

Research Organisations

Contacto administrativo

Catherine Pacherie-Simeral (Ms.)

Investigador principal

Ivan Laptev (Dr.)

Enlaces

Contactar con la organización Sitio web

Coste total

Sin datos

Beneficiarios (1)