Skip to main content

Integrated and Detailed Image Understanding

Objective

The aim of this project is to create the technology needed to understand the content of images in a detailed, human-like manner, significantly superseding the current limitations of automatic image understanding, and enabling new far reaching human-centric applications. The first goal is to substantially broaden the spectrum of visual information that machines can extract from images. For example, where current technology may discover that there is a ``person'' in an image, we would like to produce a description such as ``person wearing a red uniform, tall, brown haired, with a bayonet, and a long black hat.'' The second goal is to do so efficiently, by developing integrated image representations that can share knowledge and computation in multiple computer vision tasks, from detecting edges to recognising and describing thousands of different object types.

In order to do so, we will investigate, for the fist time in a systematic manner, the breadth of information that humans can extract from images, from abstract patterns to object parts and attributes, and we will incorporate it in the next generation of machine vision systems. Compared to existing technology, the new algorithms will have a significantly richer and more detailed understanding of the content of images. They will be learned from data building on recent breakthroughs in large scale discriminative and deep machine learning, and will be delivered as general-purpose open-source software for the benefit of the research community and businesses. In order to make these systems future-proof, we will develop methods to extend them automatically, by learning from images downloaded from the Internet with very little human supervision. These new advanced capabilities will be demonstrated in breakthrough applications in large scale image search and visual information retrieval.

Field of science

  • /natural sciences/computer and information sciences/artificial intelligence/computer vision
  • /natural sciences/computer and information sciences/artificial intelligence/machine learning

Call for proposal

ERC-2014-STG
See other projects for this call

Funding Scheme

ERC-STG - Starting Grant

Host institution

THE CHANCELLOR, MASTERS AND SCHOLARS OF THE UNIVERSITY OF OXFORD
Address
Wellington Square University Offices
OX1 2JD Oxford
United Kingdom
Activity type
Higher or Secondary Education Establishments
EU contribution
€ 1 497 271

Beneficiaries (1)

THE CHANCELLOR, MASTERS AND SCHOLARS OF THE UNIVERSITY OF OXFORD
United Kingdom
EU contribution
€ 1 497 271
Address
Wellington Square University Offices
OX1 2JD Oxford
Activity type
Higher or Secondary Education Establishments