Skip to main content
Go to the home page of the European Commission (opens in new window)
English English
CORDIS - EU research results
CORDIS
Content archived on 2024-06-18

Video and 3D Analysis for Visual Learning

Objective

"Reliable recognition of thousands of object and action categories is today's key challenge in computer vision. Most contemporary approaches are based on supervised learning algorithms to train object classifiers. While manual annotation has become easier in recent years, it is still not scalable to a large set of categories. Moreover, as it is usually based on human language it does not reflect the visual characteristics of objects, but tries to establish high-level links that should actually be learned after appropriate visual features have been captured.

In this proposal, we aim at reducing the manual labeling effort by making use of the natural organization of visual data as it is provided by a video stream. In the same setting, we also aim at learning a more sophisticated structural representation of objects. Rather than manually specifying parts and attributes of objects that have a counterpart in language, we will seek correlated visual patterns by letting the data speak. Exploiting the natural arrangement of images in video and the inherent 3D scene structure is decisive, since weakly correlated images as obtained from photo collections might not contain rich enough relationship information.

We will also consider the active observer setting, i.e. where the camera can be moving. This allows extracting far more information, but also requires detailed control of the low-level and mid-level computer vision techniques involved, particularly motion estimation and tracking. The importance of these components is often underestimated in contemporary visual learning approaches.

Apart from the impact on the field of computer vision itself, the improved performance in visual recognition that we anticipate in this project has direct consequences for many important applications, particularly automotive systems and robotics, where the use of visual sensory input is more and more considered one of the most important components of future systems."

Fields of science (EuroSciVoc)

CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: The European Science Vocabulary.

You need to log in or register to use this function

Topic(s)

Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.

Call for proposal

Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.

ERC-2011-StG_20101014
See other projects for this call

Funding Scheme

Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.

ERC-SG - ERC Starting Grant

Host institution

ALBERT-LUDWIGS-UNIVERSITAET FREIBURG
EU contribution
€ 1 462 800,00
Address
FAHNENBERGPLATZ
79098 Freiburg
Germany

See on map

Region
Baden-Württemberg Freiburg Freiburg im Breisgau, Stadtkreis
Activity type
Higher or Secondary Education Establishments
Links
Total cost

The total costs incurred by this organisation to participate in the project, including direct and indirect costs. This amount is a subset of the overall project budget.

No data

Beneficiaries (1)

My booklet 0 0